-- Logs begin at Tue 2022-08-30 03:31:42 UTC, end at Tue 2022-08-30 04:39:37 UTC. -- Aug 30 04:10:25.712635 dv-cinder-852208-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:10:25.721412 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:10:25 2022] *** Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: nodename: dv-cinder-852208-11-iscsi Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: machine: x86_64 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: clock source: unix Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: pcre jit disabled Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: detected number of CPU cores: 4 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: current working directory: / Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: your processes number limit is 47680 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: your memory page size is 4096 bytes Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: detected max file descriptor number: 2048 Aug 30 04:10:25.723445 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: lock engine: pthread robust mutexes Aug 30 04:10:25.724419 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: thunder lock: enabled Aug 30 04:10:25.724419 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:10:25.724419 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:10:25.763839 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: Python main interpreter initialized at 0x560105a389c0 Aug 30 04:10:25.763839 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: python threads support enabled Aug 30 04:10:25.763839 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: your server socket listen backlog is limited to 100 connections Aug 30 04:10:25.763839 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:10:25.764178 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:10:25.764259 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: *** Operational MODE: preforking *** Aug 30 04:10:25.764500 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:10:25.764500 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: spawned uWSGI master process (pid: 105472) Aug 30 04:10:25.764713 dv-cinder-852208-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:10:25.767011 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: spawned uWSGI worker 1 (pid: 105473, cores: 1) Aug 30 04:10:25.767011 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: spawned uWSGI worker 2 (pid: 105474, cores: 1) Aug 30 04:10:25.767011 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:10:26.433645 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:10:26.434267 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:10:27.536876 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:10:27.536876 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: from cryptography.utils import int_from_bytes Aug 30 04:10:27.537588 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:10:27.537588 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: from cryptography.utils import int_from_bytes Aug 30 04:10:27.544442 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:10:27.544442 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: from cryptography.utils import int_from_bytes Aug 30 04:10:27.544921 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:10:27.544921 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: from cryptography.utils import int_from_bytes Aug 30 04:10:30.068912 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:10:30.069444 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:10:30.069602 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:10:30.070536 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:10:30.070829 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:10:30.071217 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.071550 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.071876 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.072201 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.072536 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.072850 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.073179 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.073274 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:10:30.073636 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:10:30.073725 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.073814 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.073948 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:10:30.074070 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.074334 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:10:30.074440 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.074592 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:10:30.074744 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-11-iscsi {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.074977 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075066 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075304 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075402 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075623 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075721 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.075943 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076032 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076267 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076354 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076574 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076663 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076887 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.076975 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.077201 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.077390 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.077844 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.077844 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078073 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078209 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078353 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078474 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-11-iscsi {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078589 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078723 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.078842 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079043 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079201 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079338 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079428 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079652 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079747 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.079956 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080090 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080276 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080371 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080580 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080797 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.080981 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-11-iscsi {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081158 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081317 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081458 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081591 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081733 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.081902 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082044 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082279 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082428 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082591 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082736 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.082882 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083017 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083198 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083300 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083501 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083599 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.083878 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084030 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084211 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084305 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084515 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084634 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-11-iscsi {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084837 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.084949 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.085161 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.085261 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.085467 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.085557 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.086546 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.086646 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.086886 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087001 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087160 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087252 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087480 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087571 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087798 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.087885 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088053 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088150 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088368 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088459 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088694 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.088784 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089016 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089171 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089337 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089501 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089597 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089679 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089828 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.089929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090152 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090363 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090501 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090603 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090817 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.090908 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091129 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091217 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091375 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091462 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091683 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.091772 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092034 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092122 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092346 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092435 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092746 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.092973 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093062 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093253 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093355 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093596 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093684 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.093915 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094003 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094224 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094342 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094574 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094671 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094878 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.094966 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095187 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095293 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095489 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095579 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095800 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.095897 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096106 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096196 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096410 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096508 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096727 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.096815 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097037 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097135 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097353 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097448 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097656 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097756 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.097964 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098060 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098310 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098414 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098615 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098711 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.098923 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099023 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099182 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099385 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099514 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099704 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.099809 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100012 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100101 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100402 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100509 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100649 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100741 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.100955 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101153 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101279 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101493 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101595 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101807 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.101906 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102118 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102207 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102456 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102559 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102757 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.102854 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103055 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103150 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103359 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103470 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103668 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103779 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.103967 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104055 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104270 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104361 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104574 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104662 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104872 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.104968 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105181 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105277 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105484 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105572 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105787 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.105875 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106090 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106192 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106415 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106508 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106716 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.106804 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107022 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107121 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107317 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107409 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107617 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107706 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.107922 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108018 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108236 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108323 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108538 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108626 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108841 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.108930 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109144 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109243 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109447 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109536 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109759 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.109863 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110060 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110149 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110387 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110510 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110687 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110776 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.110987 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111091 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111282 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111396 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111586 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111682 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.111886 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112010 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112189 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112301 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112495 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112601 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112789 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.112896 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113093 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113203 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113405 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113503 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113710 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.113808 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114009 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114116 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114337 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114438 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114640 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114739 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.114984 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.115135 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.115319 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.115441 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.115638 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.115728 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.115938 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.116030 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.116233 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.116322 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.116545 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.116640 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.116908 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.117010 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.117248 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.117340 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.117556 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.117662 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.117859 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.117956 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.118175 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:10:30.118285 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.118532 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.118641 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.118862 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.118952 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119201 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119296 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119511 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119607 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119841 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.119939 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120160 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120249 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120476 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120600 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120784 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.120896 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121094 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121192 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121413 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121526 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121717 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.121814 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122024 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122124 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122354 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122467 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122669 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122768 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.122983 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123073 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123312 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123405 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123625 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123716 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.123937 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124251 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124350 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124557 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124647 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124867 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.124956 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125188 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125284 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125503 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125599 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125811 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.125903 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126127 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126218 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126468 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126561 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126795 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.126899 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127202 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127422 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127512 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127727 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.127830 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128125 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128341 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128438 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128661 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128761 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.128980 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129069 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129289 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129385 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129605 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129708 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.129916 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130041 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130233 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130349 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130575 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130689 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130891 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.130989 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131206 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131303 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131514 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131612 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131821 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.131920 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.132128 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.132228 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.132441 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133360 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133541 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133698 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133796 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.133948 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134021 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134285 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134469 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134627 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134770 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.134920 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135060 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135197 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135338 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135482 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135639 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135777 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.135915 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136050 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136193 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136351 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136499 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136638 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136781 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.136949 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137089 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137279 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137440 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137583 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137722 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.137903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138059 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138206 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138369 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138545 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138681 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138855 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.138994 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139147 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139292 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139445 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139594 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139752 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.139893 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140165 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140367 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140479 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140687 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140779 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.140997 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141089 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141300 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141390 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141621 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141713 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.141926 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142018 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142237 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142362 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142572 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142678 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142882 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.142973 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143191 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143281 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143501 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143599 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143808 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.143898 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144114 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144202 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144422 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144521 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144730 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.144826 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145038 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145133 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145347 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145446 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145654 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145745 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.145962 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.146052 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.146285 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.146443 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.146868 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147018 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147166 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147303 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147476 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147613 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147784 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.147917 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.148133 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.148962 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.149146 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.149371 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150031 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150297 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150387 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150468 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150567 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150651 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150742 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150867 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.150956 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151048 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151168 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151360 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151501 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151679 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151781 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.151994 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152087 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152311 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152400 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152625 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152714 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.152940 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153032 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153262 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153359 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153583 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153672 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.153906 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154004 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154220 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154337 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154573 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154677 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154889 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.154986 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155201 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155290 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155508 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155606 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155818 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.155918 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156131 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156220 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156442 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156591 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156755 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.156846 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157074 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157163 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157386 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157499 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157705 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.157795 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158013 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158104 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158350 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158456 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158663 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158751 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.158975 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159063 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159276 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159365 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159589 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159685 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.159909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160005 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160222 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160351 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160550 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160641 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160863 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.160996 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161170 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161266 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161479 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161611 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161786 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.161875 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162095 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162186 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162426 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162520 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162737 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.162846 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163058 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163149 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163368 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163459 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163686 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.163988 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164132 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164280 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164623 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164721 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.164940 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165032 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165244 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165557 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165647 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165885 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.165977 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166217 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166382 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166546 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166646 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166857 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.166949 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167174 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167263 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167578 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167791 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.167881 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168098 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168187 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168403 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168506 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168707 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.168797 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169015 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169105 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169330 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169428 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169640 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169738 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.169949 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.170038 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.170332 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.170715 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.171033 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.171346 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.171656 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.171967 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.172320 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.172637 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.172946 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.173269 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.173601 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.173916 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.174238 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.174575 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.174890 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.175217 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.175540 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.175854 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.176173 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.176489 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.176805 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.177120 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.177259 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.177449 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.177729 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.177819 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178067 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178157 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178441 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178545 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178708 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.178839 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.179021 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.179171 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.179393 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.179655 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.179980 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.180225 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.180365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.180635 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.180812 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.180980 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181191 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181285 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181527 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181638 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181861 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.181971 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182222 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182341 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182562 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182652 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182876 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.182964 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183226 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183305 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183544 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183622 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183856 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.183944 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184166 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184244 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184479 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184557 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184796 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.184891 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185106 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185191 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185427 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185520 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185720 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.185830 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186034 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186124 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186378 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186507 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186697 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186835 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.186999 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.187099 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.187308 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.187466 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.187629 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.187938 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.188028 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.188254 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.188562 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.188657 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.188890 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189074 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189204 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189399 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189514 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189722 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.189828 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190043 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190133 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190383 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190476 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190716 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.190831 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191053 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191151 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191428 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191639 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191792 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.191978 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.192132 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.192300 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.192441 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.192659 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.192984 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.193127 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.193374 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.193547 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.193698 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.193988 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.194160 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.194378 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.194630 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.194798 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.194941 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.195847 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.196050 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.196280 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.196501 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.196746 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.196972 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197156 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197308 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197460 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197460 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197748 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.197986 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.198324 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.198466 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.198620 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.198760 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.198971 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199129 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199264 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199448 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199597 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.199917 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200084 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200226 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200396 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200539 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200707 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.200948 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201092 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201240 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201400 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201536 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201673 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201813 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202116 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202327 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202468 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202619 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202765 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.202905 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203085 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203222 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203462 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203598 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203824 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.203959 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204119 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204258 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204396 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204544 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204690 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204836 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.204990 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.205188 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.205330 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.205571 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.205712 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.205880 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206039 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206176 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206341 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206556 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206703 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206849 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.206990 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.207159 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.207354 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.207448 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.207702 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.207804 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208008 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208099 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208314 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208404 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208620 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208724 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.208926 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209051 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209252 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209390 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209565 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209705 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.209875 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.210050 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.210204 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.210446 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.210549 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.211414 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.211647 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.211838 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212004 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212211 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212358 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212560 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212683 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.212916 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213009 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213275 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213375 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213616 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213706 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.213937 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214030 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214269 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214425 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214700 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.214928 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215027 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215242 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215334 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215549 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215640 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215857 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.215948 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216182 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216274 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216497 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216587 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216814 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.216904 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217142 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217234 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217468 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217570 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217795 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.217914 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218220 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218377 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218566 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218660 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218885 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.218984 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219198 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219289 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219512 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219601 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219824 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.219924 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220141 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220254 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220458 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220598 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220775 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.220946 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.221090 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.221312 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.221403 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.221664 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.221759 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222001 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222099 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222341 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222464 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222650 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222766 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.222977 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223069 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223289 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223380 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223601 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223705 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.223912 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224002 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224220 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224332 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224531 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224629 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224837 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.224962 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225276 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225366 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225591 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225769 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225906 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.225996 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.226213 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.226711 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.226840 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.226937 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.227073 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.227234 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.227421 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.227739 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.227842 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228053 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228144 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228476 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228573 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228795 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.228893 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229112 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229203 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229429 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229527 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229740 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.229838 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230047 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230137 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230387 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230515 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230718 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.230860 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231026 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231214 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231571 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231786 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.231934 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232073 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232249 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232376 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232572 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232673 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232897 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.232986 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.233250 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.233341 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.233588 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.233685 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.233944 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234033 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234309 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234451 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234637 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234736 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.234967 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235058 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235293 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235383 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235609 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235700 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.235917 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236006 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236225 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236314 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236536 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236626 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236846 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.236935 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237161 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237251 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237473 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237564 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237785 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.237883 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238091 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238181 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238420 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238513 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238731 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.238823 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239042 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239146 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239348 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239440 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239677 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239768 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.239986 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240254 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240346 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240579 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240669 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240882 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.240971 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.241192 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.241284 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.241494 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.241591 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.241818 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.242315 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.242720 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.243041 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.243369 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.243685 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.243815 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244005 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244163 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244323 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244482 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244624 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244795 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.244931 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245111 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245241 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245427 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245569 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245747 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.245876 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246067 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246203 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246403 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246571 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246825 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.246918 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247140 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247241 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247453 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247545 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247765 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.247864 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248070 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248170 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248372 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248463 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248681 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.248773 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249000 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249091 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249302 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249391 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249605 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249696 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.249908 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250000 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250232 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250359 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250556 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250648 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250877 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.250970 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.251238 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.251328 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.251570 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.251671 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.251902 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252041 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252209 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252306 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252537 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252674 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252848 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.252940 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253156 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253247 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253471 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253571 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253785 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.253876 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254094 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254186 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254544 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254750 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.254852 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255054 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255144 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255361 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255466 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255669 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255768 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.255978 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256068 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256282 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256374 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256605 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256696 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.256914 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.257005 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.257225 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.257358 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.258146 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.258378 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.258485 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.258670 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.258840 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259001 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259139 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259301 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259448 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259624 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.259950 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260089 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260257 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260409 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260563 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260728 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.260873 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261047 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261185 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261368 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261493 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261685 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.261816 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262020 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262142 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262360 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262502 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262675 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262851 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.262997 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263147 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263298 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263438 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263607 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263758 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.263967 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264179 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264331 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264515 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264665 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264834 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.264930 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265153 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265253 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265470 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265561 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265782 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.265873 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266097 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266196 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266429 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266521 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266733 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.266824 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267038 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267131 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267341 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267432 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267672 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.267974 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268065 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268290 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268382 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268618 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268717 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.268944 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269042 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269251 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269341 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269568 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269672 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269883 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.269983 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270203 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270325 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270549 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270684 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270869 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.270970 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.271171 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.271283 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.271475 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.271835 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272038 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272138 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272341 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272454 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272646 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272766 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.272951 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.273052 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.273993 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274105 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274196 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274319 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274576 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274667 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274888 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.274990 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.275210 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.275301 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.275513 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.275609 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.275838 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276009 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276150 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276240 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276456 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276546 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276761 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.276860 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277066 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277155 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277409 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277606 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277716 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.277924 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278044 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278337 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278444 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278614 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278703 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.278943 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279034 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279264 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279355 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279587 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279685 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279899 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.279988 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280211 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280301 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280520 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280618 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280830 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.280919 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.281139 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.281455 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.281554 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.281766 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.281858 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.282080 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.282166 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.282446 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.282722 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.282826 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283060 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283162 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283373 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283462 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283689 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.283922 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284013 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284279 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284370 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284605 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284708 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.284918 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285039 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285231 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285328 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285541 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285644 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285851 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.285951 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286179 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286312 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286524 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286647 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286836 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.286937 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287155 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287255 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287470 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287562 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287779 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.287871 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288089 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288191 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288401 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288498 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288712 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.288919 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289089 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289180 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289399 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289500 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289806 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.289947 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290137 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290315 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290566 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290788 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.290878 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291100 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291200 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291418 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291508 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291727 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.291824 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292036 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292136 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292346 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292466 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292654 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292818 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.292969 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293170 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293263 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293495 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293585 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293834 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.293933 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294154 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294277 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294493 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294586 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294806 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.294904 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295123 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295223 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295488 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295634 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295799 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.295947 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296108 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296279 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296428 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296604 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296752 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.296927 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297055 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297241 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297368 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297555 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297683 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.297880 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298035 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298185 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298380 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298518 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.298918 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299136 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299249 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299438 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299576 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299756 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.299914 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300065 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300250 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300370 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300563 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300690 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300871 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.300998 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.301181 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.301508 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.301605 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.301822 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.301912 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302225 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302477 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302584 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302793 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.302891 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303108 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303199 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303412 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303504 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303729 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.303817 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.304033 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.304130 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.304333 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.304964 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.305318 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.305630 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.305774 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.305945 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306104 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306299 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306444 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306593 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306755 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.306912 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307070 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307272 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307372 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307577 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307669 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307899 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.307998 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308220 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308310 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308541 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308631 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308855 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.308947 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309168 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309259 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309473 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309571 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309782 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.309872 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310086 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310174 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310416 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310526 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310725 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.310815 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311029 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311126 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311341 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311463 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311647 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311781 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.311956 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312105 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312260 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312430 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312571 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312746 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.312861 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313072 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313174 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313398 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313510 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313717 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.313833 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314041 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314207 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314379 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314479 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314713 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.314803 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315053 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315153 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315374 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315463 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315686 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315784 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.315995 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316094 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316302 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316390 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316607 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316704 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.316918 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317167 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317257 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317499 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317589 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317818 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.317920 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318126 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318223 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318466 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318559 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318776 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.318881 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319122 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319219 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319383 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319706 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.319810 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.320116 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.320716 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.320926 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321086 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321237 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321371 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321522 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321636 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321828 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.321949 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322135 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322279 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322466 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322590 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322776 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.322900 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323084 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323211 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323391 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323525 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323703 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.323802 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324011 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324101 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324317 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324406 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324652 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324756 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.324988 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325091 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325306 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325397 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325631 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325740 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.325944 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326035 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326278 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326371 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326593 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326695 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.326899 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327027 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327208 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327306 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327516 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327615 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.327925 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328137 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328242 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328461 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328551 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328770 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.328858 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329074 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329171 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329390 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329480 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329706 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.329803 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330019 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330119 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330371 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330466 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330703 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.330793 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331015 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331118 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331346 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331437 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331669 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331759 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.331995 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332094 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332302 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332398 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332615 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332711 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.332952 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333050 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333264 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333353 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333586 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333677 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333888 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.333979 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334192 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334322 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334520 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334613 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.334919 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335142 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335232 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335592 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335866 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.335980 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336088 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336195 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336396 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336504 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336702 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.336825 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337003 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337113 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337307 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337420 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337608 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337702 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.337913 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338005 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338214 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338354 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338539 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338664 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338842 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.338996 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339145 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339316 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339449 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339631 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339750 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.339937 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.340057 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.340182 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:10:30.340361 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.340664 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.340965 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.341267 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.341569 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.341897 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.342227 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.342560 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.342883 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.343191 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.343510 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.343818 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.344134 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.344458 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.344773 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.345082 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.345416 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.345728 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.346037 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.346371 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.346687 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.346997 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.347305 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.347631 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.347954 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.348260 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.348581 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.348898 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.349217 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.349533 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.349844 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.350172 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.350507 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.350817 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.351124 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.351465 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.351769 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.352084 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.352397 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.352710 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.353010 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.353325 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.353658 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.353981 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.354308 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.354635 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.354959 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.355302 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.355615 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.355957 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.356284 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.356597 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.356909 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.357210 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:10:30.357450 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105473) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:10:30.497189 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Registered counter for database nova_api Aug 30 04:10:30.519316 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.524051 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO dbcounter [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Registered counter for database nova_api Aug 30 04:10:30.527114 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.544442 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_db.sqlalchemy.engines [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.550833 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writer thread running {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.584077 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.context [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09c659a1-71e8-4f8a-9c9a-b85f07b69ea2(cell1) {{(pid=105474) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:10:30.588584 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.589065 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.590656 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.591388 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.591837 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.593831 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.595823 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Registered counter for database nova_cell0 Aug 30 04:10:30.599847 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Registered counter for database nova_cell1 Aug 30 04:10:30.608506 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.610029 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.context [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09c659a1-71e8-4f8a-9c9a-b85f07b69ea2(cell1) {{(pid=105473) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:10:30.610154 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.614280 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.614837 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.616358 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.616551 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.617968 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.618088 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.618170 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.620379 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_concurrency.lockutils [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105473) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.622524 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO dbcounter [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Registered counter for database nova_cell0 Aug 30 04:10:30.627001 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO dbcounter [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Registered counter for database nova_cell1 Aug 30 04:10:30.634839 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_db.sqlalchemy.engines [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.638383 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_db.sqlalchemy.engines [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.640814 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writer thread running {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.767216 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO dbcounter [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Registered counter for database nova_cell0 Aug 30 04:10:30.776860 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_db.sqlalchemy.engines [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.781672 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writer thread running {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.781893 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writer thread running {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:30.791515 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO dbcounter [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Registered counter for database nova_cell0 Aug 30 04:10:30.798575 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG oslo_db.sqlalchemy.engines [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105473) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:10:30.803285 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writer thread running {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:10:31.139125 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:10:31.140872 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: WARNING keystonemiddleware.auth_token [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:10:31.146852 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:10:31.149081 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: WARNING keystonemiddleware.auth_token [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:10:31.495268 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:10:31.498884 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: WARNING keystonemiddleware.auth_token [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:10:31.501218 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: WARNING keystonemiddleware.auth_token [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:10:31.504833 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: WARNING keystonemiddleware.auth_token [None req-d7910700-99a5-43e9-a93f-8169f8aead2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:10:31.506558 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560105a389c0 pid: 105474 (default app) Aug 30 04:10:31.509299 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:31.510554 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001870 Aug 30 04:10:31.510967 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Tue Aug 30 04:10:31 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:31.511147 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560105a389c0 pid: 105473 (default app) Aug 30 04:11:50.752692 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:50.753804 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Aug 30 04:11:50.754345 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:50.766651 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_api:SELECT=3 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:50.767632 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_cell0:SELECT=3 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:50.768943 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_cell1:SELECT=3 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:50.770002 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_cell0:SELECT=3 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:51.627142 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-b0fef005-7c29-4986-97d2-1a5aa85fae05 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:51.659681 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-b0fef005-7c29-4986-97d2-1a5aa85fae05 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898200 Aug 30 04:11:51.662386 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Tue Aug 30 04:11:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:54.109069 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:54.110077 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-3c4ea56d-6c37-44e3-ae5a-1ff93b8a3f36 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 30 04:11:54.110670 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:54.608779 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-b26723e6-d2c5-4b64-b390-91a3bc5e8ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:54.674548 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-b26723e6-d2c5-4b64-b390-91a3bc5e8ba0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557652 Aug 30 04:11:54.675282 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:11:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:11:54.688668 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:54.689484 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:54.690455 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell1:SELECT=3 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:54.691615 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:54.900067 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-973bf95f-3359-4834-95b2-30ff8e35b831 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:54.965518 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-973bf95f-3359-4834-95b2-30ff8e35b831 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281764 Aug 30 04:11:54.966110 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Tue Aug 30 04:11:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.354831 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-b26723e6-d2c5-4b64-b390-91a3bc5e8ba0 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.355847 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-b26723e6-d2c5-4b64-b390-91a3bc5e8ba0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 30 04:11:57.357049 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:58.037373 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-84daf580-e1f8-4788-9bb1-d06dfae82590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "id": "d1", "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:58.076393 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-84daf580-e1f8-4788-9bb1-d06dfae82590 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.713718 Aug 30 04:11:58.077146 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:11:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:11:58.089802 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-8d85b233-c991-45ea-a3d2-a132f6ca2844 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:58.126359 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-8d85b233-c991-45ea-a3d2-a132f6ca2844 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041012 Aug 30 04:11:58.127539 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Tue Aug 30 04:11:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:00.518846 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-84daf580-e1f8-4788-9bb1-d06dfae82590 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:00.519861 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-84daf580-e1f8-4788-9bb1-d06dfae82590 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 04:12:00.520259 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:00.928628 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-e32b370f-0c40-498d-9c0f-b2050fadaa93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:00.947989 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-e32b370f-0c40-498d-9c0f-b2050fadaa93 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420922 Aug 30 04:12:00.948668 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:00.960953 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-1151540a-0935-4aa8-954b-b83de653cd21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:00.985292 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-1151540a-0935-4aa8-954b-b83de653cd21 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028446 Aug 30 04:12:00.985953 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Tue Aug 30 04:12:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:03.450601 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-e32b370f-0c40-498d-9c0f-b2050fadaa93 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.452225 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-e32b370f-0c40-498d-9c0f-b2050fadaa93 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 30 04:12:03.455493 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:03.912139 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-2ee1394f-44dc-4f01-ab53-ef510ffc2656 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "disk": 10}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:03.932897 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-2ee1394f-44dc-4f01-ab53-ef510ffc2656 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472250 Aug 30 04:12:03.933562 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:03.946628 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-6c18a3d6-8446-48b3-bbfe-307961f09c17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:03.972129 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-6c18a3d6-8446-48b3-bbfe-307961f09c17 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029526 Aug 30 04:12:03.972771 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Tue Aug 30 04:12:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:06.373735 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-2ee1394f-44dc-4f01-ab53-ef510ffc2656 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:06.374680 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-2ee1394f-44dc-4f01-ab53-ef510ffc2656 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 30 04:12:06.375074 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:06.825510 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "name": "ds4G", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.846510 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465102 Aug 30 04:12:06.847892 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:06.874973 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-6412a010-91e0-467c-a238-8b5edb951a13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.902460 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-6412a010-91e0-467c-a238-8b5edb951a13 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032750 Aug 30 04:12:06.907264 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:09.390801 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.392210 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Aug 30 04:12:09.392690 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:09.833870 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-85c23883-b213-48e3-890d-a04272553883 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.859314 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-85c23883-b213-48e3-890d-a04272553883 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459747 Aug 30 04:12:09.859867 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:12.280068 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.281089 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-61bc2aa5-3dca-4a12-aead-69c1490a34af admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 04:12:12.281491 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:12.716195 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a7151bbc-17ff-4eed-9171-ebb2c20425fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:12.735678 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a7151bbc-17ff-4eed-9171-ebb2c20425fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447777 Aug 30 04:12:12.736338 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:12.751492 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-3b8437b6-bd1a-4059-a7ba-0171b64be65f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:12.780907 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-3b8437b6-bd1a-4059-a7ba-0171b64be65f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034417 Aug 30 04:12:12.781497 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Tue Aug 30 04:12:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.212457 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a7151bbc-17ff-4eed-9171-ebb2c20425fb admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.214156 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a7151bbc-17ff-4eed-9171-ebb2c20425fb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 30 04:12:15.214604 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:15.614658 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-024518b9-e347-4923-a77e-462aa661de04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:15.635219 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-024518b9-e347-4923-a77e-462aa661de04 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414323 Aug 30 04:12:15.635871 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:15.648725 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-3318dec7-03cb-4e94-b1d3-2ce283eec7d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:15.673734 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-3318dec7-03cb-4e94-b1d3-2ce283eec7d2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029602 Aug 30 04:12:15.674335 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Tue Aug 30 04:12:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:18.064688 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-024518b9-e347-4923-a77e-462aa661de04 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:18.065621 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-024518b9-e347-4923-a77e-462aa661de04 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 04:12:18.066027 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:18.436594 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-9e5bd20c-dce6-4d23-b63d-69143b96febe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:18.460144 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-9e5bd20c-dce6-4d23-b63d-69143b96febe admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.387899 Aug 30 04:12:18.460848 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:18.473184 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-3101e980-6664-45ff-a1af-f32fe9cd5536 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:18.503728 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-3101e980-6664-45ff-a1af-f32fe9cd5536 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034219 Aug 30 04:12:18.504414 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Tue Aug 30 04:12:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:20.993493 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-9e5bd20c-dce6-4d23-b63d-69143b96febe admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:20.994438 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-9e5bd20c-dce6-4d23-b63d-69143b96febe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 30 04:12:20.994843 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:21.461020 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-5a68e37a-c65d-4737-bee9-a2138d763a33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:21.469446 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:21.483682 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-5a68e37a-c65d-4737-bee9-a2138d763a33 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482554 Aug 30 04:12:21.484382 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:21.497297 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-da09c55e-0543-4b11-93e6-4c6a6a5de25b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:21.523046 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-da09c55e-0543-4b11-93e6-4c6a6a5de25b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029367 Aug 30 04:12:21.524259 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Tue Aug 30 04:12:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:24.016516 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-5a68e37a-c65d-4737-bee9-a2138d763a33 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:24.017538 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-5a68e37a-c65d-4737-bee9-a2138d763a33 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 04:12:24.017941 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:24.474307 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:24.496522 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471694 Aug 30 04:12:24.498302 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Tue Aug 30 04:12:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:24.510217 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-fbd5a6a6-05c7-402b-9d65-3bac2824d297 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:24.535368 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-fbd5a6a6-05c7-402b-9d65-3bac2824d297 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030021 Aug 30 04:12:24.536071 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Tue Aug 30 04:12:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:43.547404 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.548346 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 30 04:12:43.548755 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:43.559655 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:44.064004 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-a56c022f-cadc-4829-94c6-08a84e98572f admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:44.082210 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-a56c022f-cadc-4829-94c6-08a84e98572f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.527045 Aug 30 04:12:44.082764 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:45.158198 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.159233 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-a1cfb6af-7e50-426b-b435-9e16e18d0236 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 04:12:45.159635 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:45.685176 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-1bb75580-d344-4de8-9041-46edf5cc8dd4 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.690843 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.wsgi [None req-1bb75580-d344-4de8-9041-46edf5cc8dd4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-1bb75580-d344-4de8-9041-46edf5cc8dd4 admin admin] Request method failure captured: Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept: application/json Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept-Encoding: gzip, deflate Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Connection: keep-alive Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Content-Length: 0 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Host: 10.222.0.46 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-System-Scope: None Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: User-Agent: python-novaclient Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Auth-Token: gAAAAABjDY49AJk8NHXvRCmbsQGHhUzkQAH63oK9npj9eVDSjPAe649f3Axo4ofeK0M6IP7IxWuMPpjrxju1Ajk7EyGzqkcbw7vX-IHyM-ozBXkS4jp_zxZ6na-C6Vprb3SvzoLfl-T9yww3nPYf7C8y7EdISK2wHZL34DsTsy9gmAsZW2TVP9I Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Id: None Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Name: None Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Identity-Status: Confirmed Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Is-Admin-Project: True Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Id: default Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Name: Default Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Name: admin Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Role: admin,reader,member Aug 30 04:12:45.694064 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Roles: admin,reader,member Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant: admin Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Name: admin Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User: admin Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Id: default Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Name: Default Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Name: admin Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: method: > Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: exception: Flavor 42 could not be found. Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: action_args: {'id': '42'} Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:45.696452 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:45.697365 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.698763 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-1bb75580-d344-4de8-9041-46edf5cc8dd4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:45.700030 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-1bb75580-d344-4de8-9041-46edf5cc8dd4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393379 Aug 30 04:12:45.700030 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:45.705913 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-90672a2f-76fb-4488-b729-29be72a560a7 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.710048 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.732823 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-90672a2f-76fb-4488-b729-29be72a560a7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030477 Aug 30 04:12:45.733407 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:45.743926 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-989072d1-d1e3-4d46-b383-fa121b6b03e3 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.767419 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-989072d1-d1e3-4d46-b383-fa121b6b03e3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027772 Aug 30 04:12:45.767990 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:12:45.777877 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-d31507c7-4a42-47c6-9ae6-b9d9d5b18cb6 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.784349 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-d31507c7-4a42-47c6-9ae6-b9d9d5b18cb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-d31507c7-4a42-47c6-9ae6-b9d9d5b18cb6 admin admin] Request method failure captured: Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept: application/json Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Connection: keep-alive Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Content-Length: 0 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Host: 10.222.0.46 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjDY49AJk8NHXvRCmbsQGHhUzkQAH63oK9npj9eVDSjPAe649f3Axo4ofeK0M6IP7IxWuMPpjrxju1Ajk7EyGzqkcbw7vX-IHyM-ozBXkS4jp_zxZ6na-C6Vprb3SvzoLfl-T9yww3nPYf7C8y7EdISK2wHZL34DsTsy9gmAsZW2TVP9I Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Role: admin,reader,member Aug 30 04:12:45.787608 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Roles: admin,reader,member Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant: admin Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User: admin Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Name: admin Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: method: > Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: exception: Flavor 42 could not be found. Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: action_args: {'id': '42'} Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:45.790040 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:45.790909 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:45.792111 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-d31507c7-4a42-47c6-9ae6-b9d9d5b18cb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:45.793373 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-d31507c7-4a42-47c6-9ae6-b9d9d5b18cb6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015724 Aug 30 04:12:45.793373 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:12:46.763131 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-989072d1-d1e3-4d46-b383-fa121b6b03e3 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:46.764171 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-989072d1-d1e3-4d46-b383-fa121b6b03e3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 30 04:12:46.764562 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:47.301601 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-af44b887-2a27-423e-b7cf-51113bf246ff admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.307151 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-af44b887-2a27-423e-b7cf-51113bf246ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-af44b887-2a27-423e-b7cf-51113bf246ff admin admin] Request method failure captured: Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept: application/json Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Connection: keep-alive Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Content-Length: 0 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Host: 10.222.0.46 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjDY4-yql91vTPzGy9R3deBhfax8te4QNM4oxP-KeP6dkupWe2XPCrZ46s0rqtTYGZV0OeD14OhOBudTtw7YsZ1Q7jXa0OoTJCV5RyWcVu9Nb1PoSSS0m_MLB_c3LcH_ygp-QAKntbEoJR0l0TDm_SXvhSchIgEh2Cw5Ur5cErF809BjU Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Role: admin,reader,member Aug 30 04:12:47.308633 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Roles: admin,reader,member Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant: admin Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User: admin Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Name: admin Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: method: > Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: exception: Flavor 84 could not be found. Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: action_args: {'id': '84'} Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:47.310334 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:47.311321 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.312475 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-af44b887-2a27-423e-b7cf-51113bf246ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:47.313491 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-af44b887-2a27-423e-b7cf-51113bf246ff admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400803 Aug 30 04:12:47.313491 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 30 04:12:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:47.320214 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-de38684d-578d-44cc-bb90-6f134016b07d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.334641 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-de38684d-578d-44cc-bb90-6f134016b07d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018436 Aug 30 04:12:47.335164 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:47.345167 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-56c79dea-2623-46e3-8370-1b265d95bdcb admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.360290 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-56c79dea-2623-46e3-8370-1b265d95bdcb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018597 Aug 30 04:12:47.360832 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:12:47.370486 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-d0ca1a7a-96b1-4ef8-991e-8b91fb68263e admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.375804 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.wsgi [None req-d0ca1a7a-96b1-4ef8-991e-8b91fb68263e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-d0ca1a7a-96b1-4ef8-991e-8b91fb68263e admin admin] Request method failure captured: Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept: application/json Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept-Encoding: gzip, deflate Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Connection: keep-alive Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Content-Length: 0 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Host: 10.222.0.46 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-System-Scope: None Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: User-Agent: python-novaclient Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Auth-Token: gAAAAABjDY4-yql91vTPzGy9R3deBhfax8te4QNM4oxP-KeP6dkupWe2XPCrZ46s0rqtTYGZV0OeD14OhOBudTtw7YsZ1Q7jXa0OoTJCV5RyWcVu9Nb1PoSSS0m_MLB_c3LcH_ygp-QAKntbEoJR0l0TDm_SXvhSchIgEh2Cw5Ur5cErF809BjU Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Id: None Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Name: None Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Identity-Status: Confirmed Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Is-Admin-Project: True Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Id: default Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Name: Default Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Name: admin Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Role: admin,reader,member Aug 30 04:12:47.377287 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Roles: admin,reader,member Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant: admin Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Name: admin Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User: admin Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Id: default Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Name: Default Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Name: admin Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: method: > Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: exception: Flavor 84 could not be found. Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: action_args: {'id': '84'} Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:47.378903 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:47.379929 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:47.381481 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-d0ca1a7a-96b1-4ef8-991e-8b91fb68263e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:47.383435 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-d0ca1a7a-96b1-4ef8-991e-8b91fb68263e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011866 Aug 30 04:12:47.383435 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:48.361420 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-56c79dea-2623-46e3-8370-1b265d95bdcb admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.362478 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-56c79dea-2623-46e3-8370-1b265d95bdcb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 30 04:12:48.362877 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:48.893825 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-bb34d769-8521-46de-89ed-3ce4267b2535 admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.900330 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.wsgi [None req-bb34d769-8521-46de-89ed-3ce4267b2535 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-bb34d769-8521-46de-89ed-3ce4267b2535 admin admin] Request method failure captured: Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept: application/json Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Accept-Encoding: gzip, deflate Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Connection: keep-alive Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Content-Length: 0 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Host: 10.222.0.46 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Openstack-System-Scope: None Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: User-Agent: python-novaclient Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Auth-Token: gAAAAABjDY5AcX7dtdg3LoKrspcUnsHAJBtu1VGsCbREtmyBAPDJmurE7yzfHGcXfFKNEJjE5FxcPsoLc45xm-NeydclhWr52XpFgc_hmeB32yagS6B2DtkGT_kRPg6bMMLVe4KrpsWEoTwEJGURIaMQPEc5dxWbNux-th6uD9OQ3DqPh_Kq6l4 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Id: None Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Domain-Name: None Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Identity-Status: Confirmed Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Is-Admin-Project: True Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Id: default Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Domain-Name: Default Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Project-Name: admin Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Role: admin,reader,member Aug 30 04:12:48.901827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Roles: admin,reader,member Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant: admin Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-Tenant-Name: admin Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User: admin Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Id: default Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Domain-Name: Default Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: X-User-Name: admin Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: method: > Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: exception: Flavor 451 could not be found. Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: action_args: {'id': '451'} Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:48.903439 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.904498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.905823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-bb34d769-8521-46de-89ed-3ce4267b2535 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105473) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:48.907128 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-bb34d769-8521-46de-89ed-3ce4267b2535 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400281 Aug 30 04:12:48.907128 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:48.912910 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-bca3dbab-69d5-4852-a92e-c04d1be8aa92 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.932839 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-bca3dbab-69d5-4852-a92e-c04d1be8aa92 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023413 Aug 30 04:12:48.933385 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:48.943110 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.958027 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018462 Aug 30 04:12:48.958602 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:12:48.967825 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-e30c3408-f01e-4fc3-95f3-0097479de0d5 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.973131 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.wsgi [None req-e30c3408-f01e-4fc3-95f3-0097479de0d5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-e30c3408-f01e-4fc3-95f3-0097479de0d5 admin admin] Request method failure captured: Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept: application/json Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Accept-Encoding: gzip, deflate Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Connection: keep-alive Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Content-Length: 0 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Host: 10.222.0.46 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-Api-Version: compute 2.90 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Openstack-System-Scope: None Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: User-Agent: python-novaclient Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Auth-Token: gAAAAABjDY5AcX7dtdg3LoKrspcUnsHAJBtu1VGsCbREtmyBAPDJmurE7yzfHGcXfFKNEJjE5FxcPsoLc45xm-NeydclhWr52XpFgc_hmeB32yagS6B2DtkGT_kRPg6bMMLVe4KrpsWEoTwEJGURIaMQPEc5dxWbNux-th6uD9OQ3DqPh_Kq6l4 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Id: None Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Domain-Name: None Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Identity-Status: Confirmed Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Is-Admin-Project: True Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Id: default Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Domain-Name: Default Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Project-Name: admin Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Role: admin,reader,member Aug 30 04:12:48.974657 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Roles: admin,reader,member Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b409aaa1029446de8dc3bfb718ab67c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant: admin Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Id: b409aaa1029446de8dc3bfb718ab67c6 Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-Tenant-Name: admin Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User: admin Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Id: default Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Domain-Name: Default Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Id: 01e05990467f46b9b8ba90e062973118 Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: X-User-Name: admin Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: method: > Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: exception: Flavor 451 could not be found. Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: action_args: {'id': '451'} Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:48.977136 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.978244 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.979762 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-e30c3408-f01e-4fc3-95f3-0097479de0d5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:48.981063 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-e30c3408-f01e-4fc3-95f3-0097479de0d5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011647 Aug 30 04:12:48.981063 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:12:49.982823 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.983827 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 04:12:49.984234 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:50.533901 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-b8cae127-d994-4059-abe7-39be355bb8f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:50.553787 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-b8cae127-d994-4059-abe7-39be355bb8f4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.422698 Aug 30 04:12:50.554377 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 30 04:12:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:51.535501 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.536498 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 30 04:12:51.536885 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:52.073329 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-8983742b-bef4-4b7a-a230-f4783dbc22ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:52.092818 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-8983742b-bef4-4b7a-a230-f4783dbc22ca admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409696 Aug 30 04:12:52.093715 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:53.069587 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:53.071369 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Aug 30 04:12:53.071772 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:53.600062 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-68e5cefa-ff2b-42e7-80d3-e54d1fc236ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:53.620109 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-68e5cefa-ff2b-42e7-80d3-e54d1fc236ae admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406606 Aug 30 04:12:53.620581 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 30 04:12:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:12:54.586688 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:54.587685 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Aug 30 04:12:54.588078 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:55.108578 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-4aa53033-fdfc-47e4-917e-6c3317fa576a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:55.128588 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-4aa53033-fdfc-47e4-917e-6c3317fa576a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402780 Aug 30 04:12:55.129165 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Aug 30 04:12:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:12:56.123216 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.124210 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 30 04:12:56.124598 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:56.652174 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-cd703f14-3458-4b2c-9467-64c414875716 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.672754 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-cd703f14-3458-4b2c-9467-64c414875716 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407855 Aug 30 04:12:56.673305 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:50.895744 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.897296 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-2264b6bc-3e66-45d1-bdb5-567837e4cfea admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 30 04:13:50.897911 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:50.908601 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:51.290135 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-f04afc05-c83e-4b3b-9889-58b935c9fc21 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.310781 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-f04afc05-c83e-4b3b-9889-58b935c9fc21 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406593 Aug 30 04:13:51.311316 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:51.332579 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG dbcounter [-] [105473] Writing DB stats nova_api:SELECT=14 {{(pid=105473) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:51.337767 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-ab1c6abe-4823-4fd2-98b7-5b9caef8be0e admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.345611 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-ab1c6abe-4823-4fd2-98b7-5b9caef8be0e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014439 Aug 30 04:13:51.346153 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.358344 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-5a79558d-ff73-4a61-9424-a42cf0ac82e4 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.366653 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-5a79558d-ff73-4a61-9424-a42cf0ac82e4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011897 Aug 30 04:13:51.367178 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.378431 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.386807 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011921 Aug 30 04:13:51.387322 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.399342 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-f6642d1d-7d84-4ff1-a2d0-e7ebd91998e1 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.406923 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-f6642d1d-7d84-4ff1-a2d0-e7ebd91998e1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011765 Aug 30 04:13:51.407432 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:54.184417 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:54.185451 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 30 04:16:54.185918 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:54.328147 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=6 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:54.494433 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:54.498089 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:54.499429 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:54.500205 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:54.501481 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:54.502032 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:54.502522 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:54.536173 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-5f079f43-f4b7-4848-924e-fcb2c4d17164 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.210274 Aug 30 04:16:54.536746 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:16:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:16:55.381960 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.383061 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 30 04:16:55.383460 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:55.585340 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.588959 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.589460 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.589902 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.590677 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.591122 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.591542 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.611567 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-bed15100-4051-4a09-8a49-b75891b7754c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.082495 Aug 30 04:16:55.612415 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:17:06.879553 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:06.880561 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 30 04:17:06.880962 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:07.023281 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell0:SELECT=4 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.024002 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_cell1:SELECT=4 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.024611 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG dbcounter [-] [105474] Writing DB stats nova_api:SELECT=8 {{(pid=105474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:07.073184 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:07.076716 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.077194 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.077629 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.078404 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.078856 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.079278 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.104131 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-5e5ab9d0-19e1-4d7e-80e8-f164563df2bf admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085558 Aug 30 04:17:07.104682 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:17:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:07.934002 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: DEBUG nova.api.openstack.wsgi [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] Calling method '>' {{(pid=105473) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:07.935679 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: INFO nova.api.openstack.requestlog [None req-67ffc61d-82a9-4bef-9019-efc54532301d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 30 04:17:07.936084 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: [pid: 105473|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Aug 30 04:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:08.127868 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG nova.api.openstack.wsgi [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Calling method '>' {{(pid=105474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:08.131507 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:08.131985 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:08.132416 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:08.133130 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:08.133576 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:08.133992 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: DEBUG oslo_concurrency.lockutils [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:08.157948 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: INFO nova.api.openstack.requestlog [None req-2f1b667f-377a-4dff-9b67-95de83d92e76 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081952 Aug 30 04:17:08.158535 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: [pid: 105474|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Aug 30 04:17:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:05.128886 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: Tue Aug 30 04:18:05 2022 - graceful shutdown triggered... Aug 30 04:18:05.129405 dv-cinder-852208-11-iscsi devstack@n-api.service[105473]: Gracefully killing worker 1 (pid: 105473)... Aug 30 04:18:05.129011 dv-cinder-852208-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 04:18:05.130324 dv-cinder-852208-11-iscsi devstack@n-api.service[105474]: Gracefully killing worker 2 (pid: 105474)... Aug 30 04:18:06.130042 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: worker 1 buried after 1 seconds Aug 30 04:18:06.130657 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: worker 2 buried after 1 seconds Aug 30 04:18:06.130657 dv-cinder-852208-11-iscsi devstack@n-api.service[105472]: goodbye to uWSGI. Aug 30 04:18:06.131589 dv-cinder-852208-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 04:18:06.132169 dv-cinder-852208-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 04:18:06.134999 dv-cinder-852208-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:18:06.144640 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:18:06.147252 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:18:06 2022] *** Aug 30 04:18:06.147414 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:18:06.147551 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:18:06.147665 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: nodename: dv-cinder-852208-11-iscsi Aug 30 04:18:06.147767 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: machine: x86_64 Aug 30 04:18:06.147879 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: clock source: unix Aug 30 04:18:06.147991 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: pcre jit disabled Aug 30 04:18:06.148119 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: detected number of CPU cores: 4 Aug 30 04:18:06.148233 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: current working directory: / Aug 30 04:18:06.148352 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:18:06.148485 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: your processes number limit is 47680 Aug 30 04:18:06.148485 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: your memory page size is 4096 bytes Aug 30 04:18:06.148485 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: detected max file descriptor number: 2048 Aug 30 04:18:06.148485 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: lock engine: pthread robust mutexes Aug 30 04:18:06.148832 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: thunder lock: enabled Aug 30 04:18:06.148832 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:18:06.148959 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:18:06.194422 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: Python main interpreter initialized at 0x557b1a93f9c0 Aug 30 04:18:06.194422 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: python threads support enabled Aug 30 04:18:06.194422 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: your server socket listen backlog is limited to 100 connections Aug 30 04:18:06.194422 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:18:06.194869 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:18:06.194869 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: *** Operational MODE: preforking *** Aug 30 04:18:06.195339 dv-cinder-852208-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:18:06.198412 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:18:06.198412 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: spawned uWSGI master process (pid: 120477) Aug 30 04:18:06.198412 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: spawned uWSGI worker 1 (pid: 120495, cores: 1) Aug 30 04:18:06.198412 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: spawned uWSGI worker 2 (pid: 120496, cores: 1) Aug 30 04:18:06.198412 dv-cinder-852208-11-iscsi devstack@n-api.service[120477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:18:06.877388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:18:06.883234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:18:08.030568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:18:08.030568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: from cryptography.utils import int_from_bytes Aug 30 04:18:08.031201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:18:08.031201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: from cryptography.utils import int_from_bytes Aug 30 04:18:08.049868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:18:08.049868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: from cryptography.utils import int_from_bytes Aug 30 04:18:08.050517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:18:08.050517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: from cryptography.utils import int_from_bytes Aug 30 04:18:10.485328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:18:10.485328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:18:10.486044 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:18:10.486352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:18:10.486470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:18:10.486858 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.487180 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.487501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.487823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.488325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.488638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.488964 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.489495 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.489836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.490184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.490451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.490772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-11-iscsi {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.491114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.491435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.491713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.492036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.492345 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.492669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.492976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.493479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.493938 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.494242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.494585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.494947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.495247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.495568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.495904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.496817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.497137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.497499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.497944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-11-iscsi {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.498290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.498597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.498914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.499339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.499646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.499958 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.500279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.500605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.500915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.501250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.501587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.501889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.502209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.502550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.502861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.503183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.503489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.503793 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.504098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.504349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.504656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.504977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.505295 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.505615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.505866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.506117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.506464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.506786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.507099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.507406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.507713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.508012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.508325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.508632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.508939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.509244 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.509560 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.509874 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.510195 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.510526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.510848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.511256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.511550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.512598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.512990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.514884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.515330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.515490 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.515802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.516105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.516358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.516660 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.516968 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.518327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.518327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.518327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.518628 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.518822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.519040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.519346 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.519648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.519957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.520260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.520564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.520871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.521175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.521476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.521794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.522113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.522444 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.522750 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.523057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.523361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.523677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.523981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.524288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.524607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.524912 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.525215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.525531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.525836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.526140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.526479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.526779 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.527089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.527611 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.527926 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.528260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.528541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.528845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.529149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.529453 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.529756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.530061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.530383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.530701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.531023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.531333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.531639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.531942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.532259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.532595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.532924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.533264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.533577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.533908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.534236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.534576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.534890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.535204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.535526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.535835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.536147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.536455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.536771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.537093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.537459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.537741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.537895 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:18:10.538438 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.538609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:18:10.538760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.538921 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:18:10.539074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.539074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.539364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:18:10.539364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:18:10.539700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.539877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.540031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.540031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.540321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.540321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.540638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.540803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.540956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.540956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.541258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.541416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.541574 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.541735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.541880 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.542040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.542190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.542378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.542536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.542703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.542865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.543020 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.543258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.543801 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.543978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-11-iscsi {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.544127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.544280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.544425 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.544576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.544729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.544896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.545177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.545329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.545488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.545642 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.545803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.545957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.546120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.546308 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.546460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.546460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.546761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.546761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.547070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.547222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.547377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.547581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.547738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.547913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.548059 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.548203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.548348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.548501 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.548646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.548796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.548949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.549101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.549328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.549328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.549617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.549768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.549930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.550074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.550232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-11-iscsi {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.550413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.550573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.550728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.551413 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.551582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.551738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.551898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.552045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.552196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.552359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.552515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.552786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.552945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.553101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.553247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.553399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.553592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.554002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.554156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.554331 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.554580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.554744 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.554903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.555061 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.555313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.555465 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.555621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.555784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.555937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.556082 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.556232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.556377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.556520 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.556678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.556832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.557057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.557204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.557348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.557506 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.557701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.557861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.558006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.558157 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.558326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.559021 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.559251 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.559487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.559723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.559888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.560043 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.560200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.560355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.560509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.560509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.560783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.560945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.561106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.561256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.561440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.561602 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.561747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.561913 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.562059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.562217 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.562451 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.562607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.562760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.562919 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.563071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.563215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.563369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.563532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.563687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.564161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.564318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.564471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.564644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.564885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.565045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.565192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.565365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.565612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.565776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.565922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.565922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.566227 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.566227 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.566527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.566671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.566822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.566977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.567133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.567133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.567416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.567566 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.567756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.567904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.568072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.568220 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.568542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.568692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.568858 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.569007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.569173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.569173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.569489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.569651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.569804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.569962 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.570108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.570289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.570489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.570645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.570797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.570951 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.571107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.571259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.571405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.571555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.571706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.571706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.571999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.572154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.572316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.572462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.572621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.572774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.572919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.573063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.573222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.573382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.573536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.573693 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.573854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.575147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.575327 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.575475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.575657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.575898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.576064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.576219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.576363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.576518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.576681 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.576827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.576971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.577125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.577284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.577457 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.577618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.577848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.577999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.578152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.578333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.578497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.578663 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.578817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.578970 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.579203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.579352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.579504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.579504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.579791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.579945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.580091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.580244 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.580389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.580533 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.580685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.580844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.581013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.581162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.581322 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.581473 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.581629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.581788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.581935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.582087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.582233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.582416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.582571 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.582728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.582875 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.583027 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.583171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.583323 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.583474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.583641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.583802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.583949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.584094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.584441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.584616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.584616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.584911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.584911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.585456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.585456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.585754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.585929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.586168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.586340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.586766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.586969 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.587141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.587141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.587446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.588558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.588724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.588884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.589048 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.589197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.589355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.589508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.589766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:18:10.589959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590623 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.590931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.591921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592067 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.592963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.593115 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.593283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.593451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.594244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.594659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.594819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.594973 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.595138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.595572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.595740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.595895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596823 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.596971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597578 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597578 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.597868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.598871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599623 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.599936 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600237 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.600848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601741 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.601892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.602051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.602051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.602392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.602576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.602885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603510 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603820 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.603966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.604122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.604275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.604429 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.604724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.604884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.605049 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.605228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.605404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.605810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.605977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.606189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.606189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.606638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.606795 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.606942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607396 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.607858 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608465 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608667 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.608987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.609905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610409 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.610945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.611864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612159 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.612768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613504 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.613965 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.614117 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.614283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.614446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.614601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.614851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.615016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.615163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.615314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.615467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.616452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.616736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.616903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.617971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618131 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.618946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619266 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619717 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.619861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620012 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.620760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.621518 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.621753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.621753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.622924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.623937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624384 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.624861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.625097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.625247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.625391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.625544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.625710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.626957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.627968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.628119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.628882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629200 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629360 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629526 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629689 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629843 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.629996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630620 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.630940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631403 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631548 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.631853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632157 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.632894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633047 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.633884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634486 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634643 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634800 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.634954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.635331 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.635492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.635647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.635807 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.635983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.636289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.636475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.636683 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.636936 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.637093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.637259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.637484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.637660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.637836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.638099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.638328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.638493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.638640 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.638792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639038 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639192 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639345 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639500 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639658 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.639961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.640860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641157 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641303 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.641916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.642066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.642219 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.642404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.647018 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.649872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650028 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650175 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.650892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651049 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.651965 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.652739 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.653210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.653457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.653615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.653863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.654016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.654174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.654601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.655276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.655443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.655617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.655771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.655973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.656141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.656415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.656605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657195 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657679 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.657988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.658102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.658223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.658373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.658507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659823 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.659974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660126 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660326 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.660969 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661372 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661829 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.661981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.662132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.662439 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.662621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.662779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.662902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663135 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663829 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.663948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.664240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.664439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.664626 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.664792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.664959 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.665971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.666296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.666609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.666812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.667237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.667418 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.667418 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.667829 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.668077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.668338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.668633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.669238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.669404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.669550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.669706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.669706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.670146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.671515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.672569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.673961 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.674657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.675869 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676179 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.676803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.677997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.678686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.679716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.679792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.679867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.679867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680341 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680556 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680637 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.680948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681658 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.681942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.682901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.683122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.683838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.684824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685153 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685317 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685317 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685587 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.685971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686360 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686689 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.686939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.687219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.687690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.687787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.687870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.687954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.688664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690342 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690342 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.690945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691520 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.691935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692601 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.692695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.693038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.693225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.693467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.693765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.693868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.694232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.694629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.694723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.695055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.695165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.695467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.695657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.695909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.696169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.696333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.696676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700718 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700807 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700807 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.700977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701842 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.701938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702345 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.702818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.703039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.703335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.703519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.703846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.704279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.704478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.704791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.705023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.705303 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.705526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.705811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.706036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.706415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.706586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.707407 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.707524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.707614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.707700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.707877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.708039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.708381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.708777 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.708916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.709022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.709416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.709512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.709908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.710013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.710603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.710789 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.710889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.711255 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.711450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.711778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.711937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.712290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.712414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.712801 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.712912 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.713310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.713405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.713798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.713902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.714343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.714475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.714857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.715076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.715331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.715483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.715815 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.715961 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.716292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.716434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.716770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.716873 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.717248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.717378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.717728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.717884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.718221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.718461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.718896 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.719009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.719194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.719496 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.719677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.720001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.720168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.720562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.720865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.721020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.721127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.721520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.721640 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.722027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.722153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.722558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.722662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.723060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.723170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.723580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.723683 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.724076 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.724185 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725444 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.725745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.726025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.726128 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.726557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.726667 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.727058 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.727231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.727575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.727677 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.727909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.728158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.728260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.728581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.728746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.729112 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.729753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.729858 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.729858 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.730019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.730104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.730280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.730613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.730722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.731084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.731231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.731324 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.731806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.732106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.732290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.732640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.732770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.733163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.733267 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.733671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.733775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.734170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.734309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.734673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.734771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.735150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.735246 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.735628 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.735761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.736105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.736268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.736592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.736891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.737112 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.737409 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.737626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.737924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.738170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.738462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.738621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739635 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.739868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.740086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.740189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.740547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.740735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.740883 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.741328 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.741455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.741553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.741770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.741925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.742292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.742404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.742787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.742926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.743264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.743671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.744175 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.744575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.744681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.745057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.745165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.745532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.745634 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.746526 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.746664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.747158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.747278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.747563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.747646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.747906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.748131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.748229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.748550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.748660 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.748880 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.749161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.749253 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.749530 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.749712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.749864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.750984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.751213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.751322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.751553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.751656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.751868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752358 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.752939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753256 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.753882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754076 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754613 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.754991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.755123 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.755442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.755585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.755774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.755933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.756075 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.756366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.756461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.756697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.756815 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.757014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.757287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.757473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.757619 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.757797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.758300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.758443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.758772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.758870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.759245 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.759434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.759744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.760971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.761079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.761176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.761176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762699 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.762699 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763026 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763114 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.763932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764026 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.764920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765014 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765341 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.765987 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.766205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.766332 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.766562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.766719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.766889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.767182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.767276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.767499 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.767923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.768063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.768373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.768474 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.768684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.768892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.769171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.769284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.769403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.769685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.770877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771025 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.771870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.772060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.772291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.772390 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.772701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.772785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.773034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.773305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.773405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.773665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.773881 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.774013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.774311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.774632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.774956 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.775476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.775728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.775813 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.775904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776124 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776225 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776554 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776801 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.776912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.777284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.777541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.777642 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.777848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778560 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.778887 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779302 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779658 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.779971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.780243 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.780529 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.780663 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.780885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781012 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.781982 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.782168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.782461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.782569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:18:10.782666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.782863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.783185 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.783580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.783900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.784218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.784580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.784902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.785213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.785531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.785851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.786169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.786513 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.786830 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.787168 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.787471 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.787785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.788100 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.788417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.788736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.789064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.789400 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.789723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.790042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.790382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.790701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.791239 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.791538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.791884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.792200 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.792527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.793379 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.793704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.794036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.794375 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.794691 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.795005 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.795316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.795623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.795946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.796259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.796564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.796885 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.797196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.797813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.798165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.798512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.798842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.799173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.799493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.799805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.800135 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.800443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.800752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.801071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.801387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.801695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.802004 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.802341 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.802657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.802964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.803276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.803584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.803914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.804223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.804536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.804846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.805159 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.805469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.805779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.806090 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.806580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.811184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.815650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.816245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.816245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.816245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.816494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.816688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.817007 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.817325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.817637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.817952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.818292 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.818614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.819276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.819276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.819528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.819842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.820154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.820467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.820785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.821132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.821454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.821778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.822099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.822445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.822762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.823078 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.823391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.823704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.824173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.824511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.824969 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.825284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.825716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.826036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.826385 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.826713 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.827028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.827356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.827681 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.827997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.828322 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.828639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.828971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.829321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.829655 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.829984 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.830317 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.830629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.830939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.831255 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.831573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.831886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.832194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.832501 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.832813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.833122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.833429 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.833737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.834046 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.834387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.834743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.835005 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.835313 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.835620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.835926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.836234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.836544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.836852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.837161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.837674 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.837920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.838229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.838589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.838933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.839253 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.839658 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.840198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.840533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.840848 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.841181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.841509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.841833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.842149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.842513 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.842831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.843147 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.843465 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.843796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.843963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO dbcounter [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Registered counter for database nova_api Aug 30 04:18:10.844082 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.844401 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.844731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.845063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.845373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.845701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.846022 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.846382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.846691 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.847008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.847342 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.847657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.847972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.848287 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.848597 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.848915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.849235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.849550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.849864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.850183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.850532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.850860 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.851191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.851506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.851832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.852163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.852514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.852829 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.853177 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.853508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.853826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.854141 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.854476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:18:10.854721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:18:10.864459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:10.871570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:10.921930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Registered counter for database nova_api Aug 30 04:18:10.927735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.context [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09c659a1-71e8-4f8a-9c9a-b85f07b69ea2(cell1) {{(pid=120496) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:18:10.932108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.932263 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.934408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.935131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.935566 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.937660 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.939662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO dbcounter [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Registered counter for database nova_cell0 Aug 30 04:18:10.942426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:10.943806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO dbcounter [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Registered counter for database nova_cell1 Aug 30 04:18:10.950016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:10.951875 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:10.953013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:10.959656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:10.960952 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:11.007765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.context [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09c659a1-71e8-4f8a-9c9a-b85f07b69ea2(cell1) {{(pid=120495) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:18:11.012818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.012996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.014668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:11.015392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.015836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.018066 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:11.020084 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Registered counter for database nova_cell0 Aug 30 04:18:11.024089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Registered counter for database nova_cell1 Aug 30 04:18:11.031881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:11.033629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:11.039148 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:11.041725 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:11.121818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO dbcounter [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Registered counter for database nova_cell0 Aug 30 04:18:11.128435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:11.132826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writer thread running {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:11.195437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO dbcounter [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Registered counter for database nova_cell0 Aug 30 04:18:11.202736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_db.sqlalchemy.engines [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:18:11.207261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writer thread running {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:18:11.462228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:18:11.470296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:18:11.535425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:18:11.543547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:18:11.825243 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:18:11.831465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: WARNING keystonemiddleware.auth_token [None req-30e93b73-a7d2-4904-84d6-593091596423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:18:11.836961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557b1a93f9c0 pid: 120496 (default app) Aug 30 04:18:11.896934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:18:11.903602 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: WARNING keystonemiddleware.auth_token [None req-31749382-a53a-4bc7-b450-986a93ec2aa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:18:11.908934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557b1a93f9c0 pid: 120495 (default app) Aug 30 04:18:47.928417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:47.930103 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:47.931193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:47.931924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:49.137425 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-41b7c4c5-bca4-4c4c-962f-eb2f1614ff2d tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Action: 'create', calling method: .version_select at 0x7faa0e68be50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-240684067", "metadata": {"Type": "work"}}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:51.390056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-41b7c4c5-bca4-4c4c-962f-eb2f1614ff2d tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.472636 Aug 30 04:18:51.390856 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 30 04:18:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3475 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:18:51.920441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c4beaca-116d-4334-9b15-294cc81eacbd tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Calling method '.version_select at 0x7faa0e6ee9d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:51.972062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.973899 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.975288 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:51.976315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:52.529307 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c4beaca-116d-4334-9b15-294cc81eacbd tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012" status: 200 len: 353 microversion: 2.1 time: 1.126471 Aug 30 04:18:52.530089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:18:51 2022] GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 => generated 353 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:52.544616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d0f2f653-da32-4054-bad1-3183a4f77e05 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Calling method '.version_select at 0x7faa0e50fca0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.643427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d0f2f653-da32-4054-bad1-3183a4f77e05 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012" status: 200 len: 353 microversion: 2.1 time: 0.104758 Aug 30 04:18:52.644740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:18:52 2022] GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:52.658611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c6dab009-48fe-4aaa-8d80-2b5e81e426a5 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Calling method '.version_select at 0x7faa0e541ca0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.753025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c6dab009-48fe-4aaa-8d80-2b5e81e426a5 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012" status: 202 len: 0 microversion: 2.1 time: 0.098402 Aug 30 04:18:52.754439 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:18:52 2022] DELETE /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:52.767702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8b41a31-3af0-4d73-b29c-efae227cd9de tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Calling method '.version_select at 0x7faa0e5253a0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.827732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c8b41a31-3af0-4d73-b29c-efae227cd9de tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012" status: 200 len: 352 microversion: 2.1 time: 0.069314 Aug 30 04:18:52.829016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:18:52 2022] GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:18:53.841490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ddc3322-b592-4ec0-b5c9-43384bc28756 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Calling method '.version_select at 0x7faa0e541c10>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:53.901224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-2ddc3322-b592-4ec0-b5c9-43384bc28756 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] HTTP exception thrown: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ddc3322-b592-4ec0-b5c9-43384bc28756 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Request method failure captured: Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 HTTP/1.1 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-nSzGFLWDCMs7X83HAZ58rkVEEKduhI8Aa9ZqoPIXAP-ZUqwKguTK11EXlfzOz1VRNQYDD8Ipx2UjhX45onsttaTP85g1_h_FUEVnfv1BAv8TtGpFIWPq-Z7t59V3fD5_rXuHAbhaGN4Xawthd_RHjZn6Ndr33SG_7E-F2DvvQMV8 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: ea96b9dd52f143de85234abcdb3e93a0 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesGetTestJSON-742929997 Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:18:53.907339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ea96b9dd52f143de85234abcdb3e93a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ea96b9dd52f143de85234abcdb3e93a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ea96b9dd52f143de85234abcdb3e93a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ea96b9dd52f143de85234abcdb3e93a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesGetTestJSON-742929997 Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: ea96b9dd52f143de85234abcdb3e93a0 Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesGetTestJSON-742929997 Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesGetTestJSON-742929997-project Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 1db869b85397448bb15ff45866fea7f6 Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesGetTestJSON-742929997-project Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'a5983dd2-b031-4627-a1c7-f0760f60c012'} Aug 30 04:18:53.908730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. (HTTP 404) (Request-ID: req-24877f6c-7ec0-40d8-9846-41ebd0dfae9c) Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:53.909558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:18:53.910654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:18:53.911671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2ddc3322-b592-4ec0-b5c9-43384bc28756 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] Returning 404 to user: Volume a5983dd2-b031-4627-a1c7-f0760f60c012 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2ddc3322-b592-4ec0-b5c9-43384bc28756 tempest-VolumesGetTestJSON-742929997 tempest-VolumesGetTestJSON-742929997-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012" status: 404 len: 109 microversion: 2.1 time: 0.072230 Aug 30 04:18:53.912629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:18:53 2022] GET /compute/v2.1/os-volumes/a5983dd2-b031-4627-a1c7-f0760f60c012 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:00.628850 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1cc6f69f-1df8-4193-865e-6e91a08c694b tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e525a60>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:00.781101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1cc6f69f-1df8-4193-865e-6e91a08c694b tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6a7b0710-b4e9-473f-a22e-794a26a05f10" status: 200 len: 351 microversion: 2.1 time: 0.156740 Aug 30 04:19:00.782161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:19:00 2022] GET /compute/v2.1/os-volumes/6a7b0710-b4e9-473f-a22e-794a26a05f10 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:02.608374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-66c947e5-c73e-4ce6-bc35-585f100dd0f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: .version_select at 0x7faa0ed65820>, body: {"keypair": {"name": "tempest-keypair-1801178513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm6mv8/sD/R7zMkS3eI9hDTWy4Nh+jfO9fRJLSih+sfWG45xvuQonR/QfftxLYLfOHME3bWgy58lqkyI/D9py5c/8kDoOwgEAvsxeNZf3GFkV/dA8RebF8c+3fMMriXDg=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.735928 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-66c947e5-c73e-4ce6-bc35-585f100dd0f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:02.751733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-66c947e5-c73e-4ce6-bc35-585f100dd0f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for user 96d18f6efa1f4c91a6f213c095c507a3 and project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:02.778544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6b64c2fb-bc91-4094-93bb-4ba6564ad53c tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e50fc10>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.882106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6b64c2fb-bc91-4094-93bb-4ba6564ad53c tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e059bad-e1aa-4051-be10-23cba71b4e72" status: 200 len: 350 microversion: 2.1 time: 0.108437 Aug 30 04:19:02.887255 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 5/8] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:19:02 2022] GET /compute/v2.1/os-volumes/3e059bad-e1aa-4051-be10-23cba71b4e72 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:02.889360 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-66c947e5-c73e-4ce6-bc35-585f100dd0f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.563286 Aug 30 04:19:02.890149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 4/9] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:04.019886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1209358499", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:04.374023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] validate_networks() for [('524cda22-09e9-423b-b572-9d6bbb210043', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:19:04.881609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-090c1879-6b43-4ce6-bc5c-e17cda5726e1 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e404280>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:05.019120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-090c1879-6b43-4ce6-bc5c-e17cda5726e1 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9fcc19c2-0dff-474a-8ad7-0dfe84405c9d" status: 200 len: 351 microversion: 2.1 time: 0.141325 Aug 30 04:19:05.019684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:19:04 2022] GET /compute/v2.1/os-volumes/9fcc19c2-0dff-474a-8ad7-0dfe84405c9d => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:05.033450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-173967f0-1f32-48a1-8fa7-ea2c73deeeab tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e4048b0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:05.276881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-173967f0-1f32-48a1-8fa7-ea2c73deeeab tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.246457 Aug 30 04:19:05.277949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1134 bytes} [Tue Aug 30 04:19:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:05.292289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a57277c4-77fb-46bf-9cc5-3ab95860f704 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e413af0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:05.551330 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a57277c4-77fb-46bf-9cc5-3ab95860f704 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.263376 Aug 30 04:19:05.552468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1149 bytes} [Tue Aug 30 04:19:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:05.567693 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0034e838-0cea-420e-9eab-6e76db740eb6 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e4dcee0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:05.835035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0034e838-0cea-420e-9eab-6e76db740eb6 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.270888 Aug 30 04:19:05.836064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 8/13] 10.222.0.46 () {58 vars in 1134 bytes} [Tue Aug 30 04:19:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:05.854086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85671278-1e32-4c9d-aeda-f625fc3fa304 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e448d30>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:06.117547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85671278-1e32-4c9d-aeda-f625fc3fa304 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.269548 Aug 30 04:19:06.120820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 9/14] 10.222.0.46 () {58 vars in 1167 bytes} [Tue Aug 30 04:19:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:06.134296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee0f1e35-27ee-42df-9f17-b6364644a194 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e414af0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:06.513636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee0f1e35-27ee-42df-9f17-b6364644a194 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.383529 Aug 30 04:19:06.514215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 10/15] 10.222.0.46 () {58 vars in 1170 bytes} [Tue Aug 30 04:19:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:06.530552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eefece37-3f4c-4c42-85b9-b830f05676c0 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e404670>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:06.959216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eefece37-3f4c-4c42-85b9-b830f05676c0 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.432149 Aug 30 04:19:06.959797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 11/16] 10.222.0.46 () {58 vars in 1155 bytes} [Tue Aug 30 04:19:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:06.978120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bf931b8f-2dab-427b-bd25-cb99f0019666 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e413430>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:07.260097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bf931b8f-2dab-427b-bd25-cb99f0019666 tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.286554 Aug 30 04:19:07.261829 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 12/17] 10.222.0.46 () {58 vars in 1188 bytes} [Tue Aug 30 04:19:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:07.289577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-44de9db5-e13b-4402-9a55-d7ae329b831b tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] Calling method '.version_select at 0x7faa0e404790>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:07.606588 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-44de9db5-e13b-4402-9a55-d7ae329b831b tempest-VolumesTestJSON-1249597649 tempest-VolumesTestJSON-1249597649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.334142 Aug 30 04:19:07.608455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 13/18] 10.222.0.46 () {58 vars in 1155 bytes} [Tue Aug 30 04:19:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:08.360150 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1ec4e719-e5aa-4276-9e5a-98b401f1949e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: .version_select at 0x7faa0e4144c0>, body: {"keypair": {"name": "tempest-keypair-1667504083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1hjaBcpHvba8xRQJAAS2eBNG6hM6PrtJkdeKAhIEgPCcCS+Jwt6qNNfza7yL7RoREAXHUMIPWW3UZ4CTwNQGUmERVi/oDgkYLNdnto+K2P02pah3aftYgAG192elwOWA=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:08.385851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-1ec4e719-e5aa-4276-9e5a-98b401f1949e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for project 411b8da28bed456bbdcdb01587610b47. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:08.391822 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-1ec4e719-e5aa-4276-9e5a-98b401f1949e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for user 8c30ec9810204a4685590c42707e41f8 and project 411b8da28bed456bbdcdb01587610b47. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:08.423140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1ec4e719-e5aa-4276-9e5a-98b401f1949e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.132572 Aug 30 04:19:08.434195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 14/19] 10.222.0.46 () {62 vars in 1200 bytes} [Tue Aug 30 04:19:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 04:19:08.485760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:08.486344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:08.486850 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:08.487315 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:08.487794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:08.518461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:08.519688 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:08.523229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:08.524275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:08.525010 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:08.525638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:08.603414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:08.627826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for user eb61948f41344ea481024a96cf03db37 and project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:08.665022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:08.676980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:08.937799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3e5535be-4246-4fdf-ac6a-6d6a02b2392b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.087943 Aug 30 04:19:08.941524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 6/20] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 5093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:08.959493 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-89b83d13-14fd-4f6e-947e-525849632152 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:08.960907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-89b83d13-14fd-4f6e-947e-525849632152 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:09.058826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-577048411", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "networks": [{"uuid": "38cf1e98-cd39-44e7-9101-9b1264f447b9"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:09.239291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] validate_networks() for [('38cf1e98-cd39-44e7-9101-9b1264f447b9', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:19:09.332107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-89b83d13-14fd-4f6e-947e-525849632152 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:09.360858 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-89b83d13-14fd-4f6e-947e-525849632152 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1222 microversion: 2.1 time: 0.410448 Aug 30 04:19:09.363575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 7/21] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:08 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:09.493950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1522570051", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:09.603671 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] validate_networks() for [('524cda22-09e9-423b-b572-9d6bbb210043', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:19:10.844081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:10.844848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:10.845533 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:10.846475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:10.847061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:10.901927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.919668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.923989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:10.930568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.934160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.937521 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.043920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:11.053615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for user eb61948f41344ea481024a96cf03db37 and project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:11.117459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:11.130816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:11.419883 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d18a7818-2ef6-4bd1-8594-7145f07864df tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.918097 Aug 30 04:19:11.429335 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 8/22] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:19:11.467046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-503141564", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f55c98a9-cbed-4af8-92a6-c49957223dcb"}], "security_groups": [{"name": "tempest-securitygroup--1455279898"}], "key_name": "tempest-keypair-1801178513", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:11.653586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:11.654351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:11.654487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:11.658366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:11.658366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:11.703955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.704222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.708218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.711320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.714924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.715447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.884180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Getting quotas for project fe278e07fd7940dca53f7c2b8b792326. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:11.915940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Getting quotas for user b0e68c885560485ead1c61fe83fc3ce4 and project fe278e07fd7940dca53f7c2b8b792326. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:11.949420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] validate_networks() for [('f55c98a9-cbed-4af8-92a6-c49957223dcb', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:19:11.979470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:11.983657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:12.191299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-52f3a1f9-da5b-4f6f-b7fc-7c5e85e941c0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.349675 Aug 30 04:19:12.198808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 15/23] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:12.222487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-86e9556b-1fa5-400e-a09e-719a4bd3e55e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:12.226437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-86e9556b-1fa5-400e-a09e-719a4bd3e55e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:12.506222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86e9556b-1fa5-400e-a09e-719a4bd3e55e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.535412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-86e9556b-1fa5-400e-a09e-719a4bd3e55e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1222 microversion: 2.1 time: 0.333648 Aug 30 04:19:12.538230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 16/24] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:12 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:12.551041 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edfe41ec-ad3e-4e00-a6ff-a04f1c8ee576 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:12.562901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edfe41ec-ad3e-4e00-a6ff-a04f1c8ee576 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:12.709943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfe41ec-ad3e-4e00-a6ff-a04f1c8ee576 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.721193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edfe41ec-ad3e-4e00-a6ff-a04f1c8ee576 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1214 microversion: 2.1 time: 0.181170 Aug 30 04:19:12.734753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 17/25] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:12 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:13.565149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5a88b9f0-5a0a-412c-aa61-ca8dac58cf8b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:13.565877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5a88b9f0-5a0a-412c-aa61-ca8dac58cf8b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.027209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:14.027865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:14.029417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:14.030020 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:14.030541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:14.077508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.078916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.082692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.084210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.085839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.086356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.137971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:14.149639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for user 96d18f6efa1f4c91a6f213c095c507a3 and project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:14.195506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5a88b9f0-5a0a-412c-aa61-ca8dac58cf8b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.209063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:14.209700 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5a88b9f0-5a0a-412c-aa61-ca8dac58cf8b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1222 microversion: 2.1 time: 0.649470 Aug 30 04:19:14.224134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:14.230878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 18/26] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:13 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1222 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:14.257771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.277492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.288780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.301654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.303246 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.305983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.308004 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.309971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.433542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3f833e9a-e1a4-472c-ad5a-a7690da5c039 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.970240 Aug 30 04:19:14.437150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 9/27] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:14.468576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2a8744d7-d15e-4016-962e-ee480382e527 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.473691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2a8744d7-d15e-4016-962e-ee480382e527 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.656524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2a8744d7-d15e-4016-962e-ee480382e527 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.669176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2a8744d7-d15e-4016-962e-ee480382e527 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1237 microversion: 2.1 time: 0.226227 Aug 30 04:19:14.672326 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 10/28] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1237 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:14.966783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.000927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7c54cc65-5f80-47cf-9440-4e29cd511fe4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1266 microversion: 2.1 time: 0.767160 Aug 30 04:19:15.006282 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 19/29] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1266 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:15.243108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.243723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.262684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.270362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.273427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.276084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.276775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.277219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.694771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-58eaa6d3-1995-441c-a2e2-4e3dc80dfd82 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.695495 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-58eaa6d3-1995-441c-a2e2-4e3dc80dfd82 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.779823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.905287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-20808521-99fa-418c-b025-6fab4876a077 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1274 microversion: 2.1 time: 0.664455 Aug 30 04:19:15.911772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 11/30] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1274 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:15.930979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838068418", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac6df5cf-677b-40fd-8aa9-efd2a9db3cd6"}], "security_groups": [{"name": "tempest-securitygroup--919005834"}], "key_name": "tempest-keypair-1667504083", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:16.043900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-58eaa6d3-1995-441c-a2e2-4e3dc80dfd82 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.059495 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-58eaa6d3-1995-441c-a2e2-4e3dc80dfd82 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1237 microversion: 2.1 time: 0.369738 Aug 30 04:19:16.078668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 20/31] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1237 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:16.084427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:16.085677 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:16.096283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.097223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.097944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.099134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.100296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.101826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.531524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.549661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6751a92e-552e-4272-80db-c4edbc4acb90 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1284 microversion: 2.1 time: 0.465612 Aug 30 04:19:16.568479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 21/32] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:16 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1284 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:16.933991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:16.934831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:16.950000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.952073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.952902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.958210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.962499 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.967090 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.305027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.321802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3edd257f-7900-457a-9802-576c9ecb6db3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1280 microversion: 2.1 time: 0.393117 Aug 30 04:19:17.325547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 22/33] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:16 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1280 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:17.342972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.343824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:17.357707 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.360365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.362757 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.364484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.365509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.366203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.484610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] validate_networks() for [('ac6df5cf-677b-40fd-8aa9-efd2a9db3cd6', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:19:17.604147 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.634363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-167b6428-45c6-468f-a448-9aeeab726c44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1289 microversion: 2.1 time: 0.306443 Aug 30 04:19:17.649869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 23/34] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1289 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:17.661470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.662483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:17.670575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.671232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.671826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.672870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.673474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.674104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.909493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.933260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b1219752-94cf-48b5-a14e-97ee40e43b66 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1272 microversion: 2.1 time: 0.270527 Aug 30 04:19:17.950823 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 24/35] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:18.349715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:18.350930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:18.374035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.374798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.377900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.382816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.383695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.386285 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.648889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:18.668726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bab830ce-9db3-4c0d-8d27-7039abb588cb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1280 microversion: 2.1 time: 0.326728 Aug 30 04:19:18.676518 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 25/36] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:18 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:18.683657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:18.686198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:18.703632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.706746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.707627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.709376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.712839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.713805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.868437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:18.877600 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7f65da6a-55ed-49a3-9b0e-ae309dfd4a44 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1295 microversion: 2.1 time: 0.199697 Aug 30 04:19:18.878190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 26/37] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:18 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1295 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:18.958302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:18.959911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:18.978348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.979295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.979910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.981025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.981860 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.982740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:19.159807 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.179058 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3aa1a1db-0d44-4239-8cc8-c6acab647335 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1272 microversion: 2.1 time: 0.225905 Aug 30 04:19:19.190819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 27/38] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:18 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:19.702352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:19.703034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:19.714774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:19.720981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:19.728230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:19.732967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:19.734104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:19.736166 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.189429 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:20.189932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:20.190325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:20.190732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:20.191137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:20.218782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.219343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.219831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.220628 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.221189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.221684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.280253 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for project 411b8da28bed456bbdcdb01587610b47. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:20.286518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for user 8c30ec9810204a4685590c42707e41f8 and project 411b8da28bed456bbdcdb01587610b47. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:20.323491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:20.330028 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:20.505039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-183e7824-66e2-41c8-9b76-09447a124d33 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.580269 Aug 30 04:19:20.513441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 12/39] 10.222.0.46 () {62 vars in 1188 bytes} [Tue Aug 30 04:19:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 4596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:19:20.530684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:20.534960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:20.568563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.570007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.571065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.574105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.575226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.576376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.836561 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.856774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2452c63d-58cd-46e7-8910-cbb5e9111a6a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1295 microversion: 2.1 time: 0.346542 Aug 30 04:19:20.859891 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 13/40] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:20 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1295 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:20.877374 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:20.878360 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:20.920178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.920836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.921492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.926224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.926974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.927878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:21.833857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:22.327194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.337654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-303a277a-1f97-4238-8b27-e1094bc566fa tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 2.640295 Aug 30 04:19:22.344750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 28/41] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:19 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:22.357705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:22.361126 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:22.365300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.378538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fe8875cb-efa6-4108-b686-c84801cbe2c8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 1.514720 Aug 30 04:19:22.380025 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 14/42] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:20 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:22.391226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:22.393293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:22.397218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.399839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.403748 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.406842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.407415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.408774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.410188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.410912 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.411518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.415278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.416207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.417270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.551457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.569613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.572645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.576408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-301dc01b-b188-468c-ae99-7bd18b96e5c7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1286 microversion: 2.20 time: 0.228368 Aug 30 04:19:22.577203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 29/43] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:22 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:22.639384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.651408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b448a028-f06f-487a-bf8d-18b4eda71cdc tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1295 microversion: 2.1 time: 0.269433 Aug 30 04:19:22.652249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 15/44] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:22 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1295 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:23.362092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.364002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.376321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.381584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.388133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.389198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.389890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.390573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.411856 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.413280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.440946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.446295 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.447164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.450077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.451685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.452304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.699653 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.713667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c58f6bc7-dc83-4832-8b25-595ccb0b4194 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.357080 Aug 30 04:19:23.723678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 30/45] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:23.739115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.740262 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.748062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.749211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.750863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.752019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.752676 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.753226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.850206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.859991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-52095c6e-2f94-46fc-b886-3e0bb5d40c86 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.457822 Aug 30 04:19:23.865310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 16/46] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:23.882792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.884218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.886000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.897817 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.899986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.900943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.902133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edfdfad7-5726-42d8-a36f-599365c0b01a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.177083 Aug 30 04:19:23.903610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 31/47] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:23.904017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.904469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.905192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.905641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.908464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.076179 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.089130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-14bea6f3-ac15-428c-893d-efc7d209f000 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.222705 Aug 30 04:19:24.089778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 17/48] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:24.158463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23aaf8c2-d8be-49ca-a496-4d9713c03f46", "tag": "9a8ac484-1ffe-4f46-8407-35f8d0244af1"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:24.171243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.171923 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.172344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.192529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Creating event network-changed:9a8ac484-1ffe-4f46-8407-35f8d0244af1 for instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 on hv-cinder-85220 Aug 30 04:19:24.193427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:19:24.193427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-39b18254-2bd5-46db-af8b-30fe35ed88a8 req-c870ff4a-a058-45bb-8dc9-bd810e826936 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:19:24.194445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.194898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.195424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.196099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.196535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.196940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.205730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.compute.rpcapi [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:19:24.206639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:19:24.226905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ab413d3b-eeef-4102-b9d9-29a98050b1c6 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295370 Aug 30 04:19:24.227716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 32/49] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:24.737744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:24.738680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:24.744889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.745381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.745813 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.746734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.747347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.747778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.889232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:24.890064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:24.902851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.904405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.904931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.907125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.907737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.908307 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.965542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.973412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f9bba141-4014-4ba5-a068-d8a35e304f41 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.239811 Aug 30 04:19:24.974120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 18/50] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:24 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:25.001440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:25.004270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:25.015717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.016510 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.017619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.025073 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.026171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.026630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.128190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.139599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.143788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.145281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1ed3634d-236d-4f0d-a0cf-269b0ecec900 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.157955 Aug 30 04:19:25.147378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 19/51] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:24 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:25.153167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:25.153916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:25.161542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.162192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.162904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.163797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.164447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.165591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.177040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.185560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5a1b5941-229d-4e05-a279-b316e2c7e19d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.303973 Aug 30 04:19:25.186139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 33/52] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:24 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:25.367740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.377597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e1dac65a-70e3-4b17-9b21-f8616724c6c5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.228770 Aug 30 04:19:25.378184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 20/53] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:25 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:25.998759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:25.999468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.005557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.006040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.006498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.013644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.015581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.016562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.055284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=22 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:26.171422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:26.172189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.180008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.180497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.180985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.181765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.185022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.186302 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.230406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.244718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7bf69697-f9ed-46a6-b045-48bcc0226985 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.251587 Aug 30 04:19:26.249329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 34/54] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:25 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:26.254791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:26.255637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.264037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.264707 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.265284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.266172 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.266794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.267621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.278521 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.298105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.303966 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.305348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a5f6edf2-3b11-4639-8d5d-241fe102adfa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.139553 Aug 30 04:19:26.309293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 21/55] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:26 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:26.416269 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:26.423719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.431339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.432419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.432846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.433723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.434404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.434991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.486837 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.505183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-10162176-fa23-45b4-8d1c-c9adea38069e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.254333 Aug 30 04:19:26.505805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 35/56] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:26 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:26.593098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.601387 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-379c1d1d-1d01-4020-b9ca-bc502768af25 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.188844 Aug 30 04:19:26.601968 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 22/57] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:26 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:27.266690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.267570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.273583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.274059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.274552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.275238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.276455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.276686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.295134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:27.329991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.331372 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.347158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:27.350300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.351150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.351586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.354483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.354483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.354483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.434932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.437999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.446714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-10146dce-22b0-4399-99f2-c7de4d80d7c3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.184105 Aug 30 04:19:27.446992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.448113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 36/58] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:27.449651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.450901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-38fd691f-e1e4-47fd-9820-6e1d8982d962 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.125010 Aug 30 04:19:27.451454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 23/59] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:27.529557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.530299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.536458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.537246 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.537879 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.538734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.539357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.539831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.626099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.627080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.633895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.634414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.635930 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.636446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.637085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.637513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.682918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.694354 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ce0d6a1e-e1b3-4d0d-8de9-857e3bd98773 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.168875 Aug 30 04:19:27.694942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 37/60] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:27.810422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:27.819769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d7adaf47-423b-4269-a576-9ad278004b03 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.198434 Aug 30 04:19:27.820527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 24/61] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:28.468169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.469625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.474893 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.476540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.480673 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.481201 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.481739 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.482493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.483171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.483991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.484653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.485415 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.486037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.487172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.487784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.488357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.593402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.609723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.611213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.612308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5c083cd0-02a6-402b-80ee-9d7d7d7947ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.142822 Aug 30 04:19:28.613287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 25/62] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:28.688680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.701517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e1388f6e-1871-412c-9b90-c10fa95bd9e3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.237422 Aug 30 04:19:28.702535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 38/63] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:28.719610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.720816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.727797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.728990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.729764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.730828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.731623 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.732599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.842221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.843335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.851600 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.852217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.852657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.853463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.854462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.855065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.907688 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.915860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-512db901-00a1-4712-941f-761f4ad4be5b tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.202886 Aug 30 04:19:28.932579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 26/64] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:29.023264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.032917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-126c40d4-f160-46fd-949b-ac8aebad9554 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.195693 Aug 30 04:19:29.042356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 39/65] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:29.638894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:29.640567 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:29.651816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.653691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.654450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.655828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.656576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.657332 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.663421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:29.724059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:29.725101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:29.733716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.734195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.738611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.738822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.739385 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.740228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.741242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.755512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.755512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.756297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-08ee2981-bb58-4126-816a-9878feeb9bc2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1278 microversion: 2.20 time: 0.121737 Aug 30 04:19:29.762293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 27/66] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:29 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:29.940351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:29.941038 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:29.952246 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.953378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.954296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.955248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:29.955907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:29.957217 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.261519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:30.299798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=28 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:30.311903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:30.326869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d0d20056-0101-44d3-9d27-dcf5ef60d15d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.606915 Aug 30 04:19:30.329268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 40/67] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:29 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:30.342711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:30.345715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:30.361674 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:30.363844 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.365629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.366543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.367565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.368512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.369824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.586836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:30.604490 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bdf37079-f0b8-4f7a-affc-a1759983d89a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.665400 Aug 30 04:19:30.605145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 28/68] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:29 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:30.781831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:30.783630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:30.794694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.795161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.795612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.796377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.796822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.797239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.324420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.346842 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.348732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.350393 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f9010829-6197-4265-8ae4-ba31931447b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1334 microversion: 2.20 time: 0.572407 Aug 30 04:19:31.351723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 29/69] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:30 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1334 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:31.352259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.358062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.359173 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.367339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.367826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.368260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.368954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.370153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.371072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.376300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3dca13eb-34f1-41f5-889d-e95380a78a71 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 1.045788 Aug 30 04:19:31.377377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 41/70] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:30 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:31.625784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.626846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.633383 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.634229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.634943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.635590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.636296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.636770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.793724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.806400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-59f1f550-82ef-4615-bd44-8ec9076b54ed tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.452992 Aug 30 04:19:31.807414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 30/71] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:32.332701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.344153 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b4a6fd66-46a3-49e2-9ad0-31b01fd001f4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.722123 Aug 30 04:19:32.369628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 42/72] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:32.376409 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.377063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.410860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.413024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.414003 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.414471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.415368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.416837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.417531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.418164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.451008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.458363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.458836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.461955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.462448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.467474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.550271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.566849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.569228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.571153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-906c1be8-0242-4951-9b2d-6909ae84b87d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1340 microversion: 2.20 time: 0.199605 Aug 30 04:19:32.574588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 31/73] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:32.830920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.831669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.845958 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.846505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.847000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.847911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.848505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.849263 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.080661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.088717 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85cc0fe5-2132-4024-8789-e3525144a9f2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.690749 Aug 30 04:19:33.103681 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 43/74] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:33.132371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.144535 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a07c544c-b085-4ff5-8f7e-36c7e2b7bedb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.319282 Aug 30 04:19:33.146393 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 32/75] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:33.374979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:33.375641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:33.390131 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.390947 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.391562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.392708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.393319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.393889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.679619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa060fe-649e-4f72-9288-d7d92a36e037", "tag": "b8e75002-6c9d-47c3-a24b-44a2b69a1fc6"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:33.695428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.696584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.698286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.723665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Creating event network-changed:b8e75002-6c9d-47c3-a24b-44a2b69a1fc6 for instance daa060fe-649e-4f72-9288-d7d92a36e037 on hv-cinder-85220 Aug 30 04:19:33.724185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:19:33.724567 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-ac6ab2a5-5236-49e5-a18f-a28bea934866 req-f2753dc0-93eb-46fb-883b-f15f51ff2c65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:19:33.725597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.726598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.727189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.729142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.729796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.730435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.744906 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.compute.rpcapi [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:19:33.746140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] Releasing lock "compute-rpcapi-router" {{(pid=120496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:19:33.765679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-da2054ff-0f60-429e-8e87-79bb602f7c0a None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208557 Aug 30 04:19:33.767008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 33/76] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:33.774079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:33.775940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:33.785590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.786453 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.787841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.789166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.789890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.791224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.971406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.993957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.004719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.011590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8af03132-963b-437b-87df-9a35223819d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1340 microversion: 2.20 time: 0.242823 Aug 30 04:19:34.012211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 34/77] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:33 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1340 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:34.014297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.024731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d6b30186-79f5-4a25-896a-c64d356f8333 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.653018 Aug 30 04:19:34.039497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 44/78] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:33 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:34.110319 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.110934 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.121440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.121631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.122069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.122808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.127972 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.128426 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.169840 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.171305 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.184233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.187116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.187799 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.190229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.193178 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.194650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.208573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:34.454694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.471974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2da8ac1f-4353-465c-a562-582cebdb7e8b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.363917 Aug 30 04:19:34.474029 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 35/79] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:35.042808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.044160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.067269 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.067886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.068510 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.074186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.074186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.074186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.316744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.329237 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.331006 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.332325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-32b26ede-4d78-45f0-8ac7-765a27bbea8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.298037 Aug 30 04:19:35.333873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 36/80] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:35.339941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.340925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.349131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.350170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.351424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.352489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.353089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.356996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.494477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.506482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cf7c8abc-5e83-48f4-bcd3-f0083fbad9ff tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 1.340874 Aug 30 04:19:35.511494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 45/81] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:35.520368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.521213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.542202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.544591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.546213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.547305 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.547966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.548614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.581412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.592371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-11075ee4-2769-40a6-abdb-d011a0dfdc74 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.257273 Aug 30 04:19:35.605816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 37/82] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:35.988785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67620860-4433-443f-9ed6-f67a98bf44cf", "tag": "84574c99-3886-4ef8-b113-d17a2f4ac835"}, {"name": "network-changed", "server_uuid": "5fde664c-f504-436a-bc03-41126ce28efe", "tag": "df23e2a1-bcf8-455e-aa83-acb143334ab7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:36.012251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.012716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.013342 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.038786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Creating event network-changed:84574c99-3886-4ef8-b113-d17a2f4ac835 for instance 67620860-4433-443f-9ed6-f67a98bf44cf on hv-cinder-85220 Aug 30 04:19:36.039712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] Creating event network-changed:df23e2a1-bcf8-455e-aa83-acb143334ab7 for instance 5fde664c-f504-436a-bc03-41126ce28efe on hv-cinder-85220 Aug 30 04:19:36.066814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-3718cf54-d841-4582-a265-c0f3aa4fd127 req-c10602af-8339-4879-825f-57b23ad85d94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075527 Aug 30 04:19:36.066814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 38/83] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:36.340329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.348411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22da9708-af61-459a-8825-9a8bc44435a5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.835475 Aug 30 04:19:36.359078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.359517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.360322 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 46/84] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:36.366420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.366861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.371249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.374048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.374691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.375259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.533927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.535839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.549122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.550159 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.553069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.556859 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.558364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.559022 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.663007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.677298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.678787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.684768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-051c627b-0322-4805-976b-25910e8caeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.329708 Aug 30 04:19:36.685306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 39/85] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:36.717545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.718164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.733055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.733848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.735561 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.737439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.737936 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.739794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.934297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.942568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.945512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9dd180b0-7e58-4b8e-9463-696086d46ec7 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.238304 Aug 30 04:19:36.946136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 40/86] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:36.965728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d82de04f-5e9d-4269-a041-97054cf7f65c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.437829 Aug 30 04:19:36.966819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 47/87] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:37.380728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.381337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.389460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.389946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.390412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.391355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.392015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.394489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.553738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.561768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0b9645fd-e9fe-44b0-a04a-f4099ec7a2b6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.184719 Aug 30 04:19:37.562528 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 41/88] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.710886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.712059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.718798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.719272 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.719701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.720382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.720823 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.721236 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.863313 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.874204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.875672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.876768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ebb51fdf-f740-4576-bb09-b16837c55171 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.169871 Aug 30 04:19:37.877326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 48/89] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:37.967641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.968517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.975584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.976253 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.976842 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.977820 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.979262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.979865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.987711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.988319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.995469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.996596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.997263 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.998229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.998699 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.999285 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.135922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.143715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-73b23f3e-4713-4586-8200-21daf451608f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.180047 Aug 30 04:19:38.144385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 42/90] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:38.148976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:38.158866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.159463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.160113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.168037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.172281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] Creating event network-changed:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:19:38.177832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-55f4d000-c75b-432b-a5a7-e55c6ed99912 req-b5d42c19-e32a-4793-bf1e-1ccc00618b13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032048 Aug 30 04:19:38.178995 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 43/91] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:38.182665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-60a914e3-67fd-4880-aa5e-9a9682c0161d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.197870 Aug 30 04:19:38.183476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 49/92] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:38.582841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.583565 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.591307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.592445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.592888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.593776 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.594280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.594707 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.779575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.787219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30c0ae18-c385-4bb1-b07d-74266bd26c04 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.208519 Aug 30 04:19:38.787782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 44/93] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:38.899973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.901370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.907563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.908045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.908470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.909169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.909616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.910033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.165023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.165533 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.172516 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.173248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.173665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.174662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.175104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.175664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.201143 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:39.340585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.352037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ba724a79-c090-45df-b516-60d5e01d7d0d tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.190387 Aug 30 04:19:39.353207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 45/94] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:39.359265 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.360063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.367154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.367956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.368600 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.370598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.371293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.372095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.536652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.545338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.559264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.560786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.561936 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-73dbb497-e7b9-48cf-aca8-df428c98cc5f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.666021 Aug 30 04:19:39.564057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 50/95] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:39.569287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-59fae5f9-f203-40cb-8288-af5d51755e3b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.214041 Aug 30 04:19:39.570047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 46/96] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:39.810029 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.810874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.819349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.820296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.821197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.822101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.823608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.824432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.972204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.984380 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7973d6ae-2453-48fe-bc27-865298efca49 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.179136 Aug 30 04:19:39.985553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 51/97] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:40.373606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.374296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.380393 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.380854 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.381283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.381956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.382431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.382839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.584299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.593180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.593785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-446da38e-f8f5-415d-b669-c630d7ccd43e tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.224179 Aug 30 04:19:40.594069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.594379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 47/98] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:40.611249 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.611810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.612372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.613470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.613926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.614443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.617916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.619900 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.626058 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.626633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.627143 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.627907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.628428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.628919 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.797290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.806612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.810395 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.813079 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b4a84dcc-fb99-4981-97bf-5d3842e0fe4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.225727 Aug 30 04:19:40.815938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 52/99] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:40.972936 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.981903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-874e729f-f64f-4eec-8ce0-8ded46d413a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.370472 Aug 30 04:19:40.990160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 48/100] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:41.006115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.006927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.015718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.016314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.016850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.017912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.018498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.019188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.023996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:41.168498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:41.176121 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-47ace4c8-93ed-41b7-9c92-c4ce41cbae1f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.173799 Aug 30 04:19:41.176685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 53/101] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:41.614674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.615313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.623725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.624280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.624627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.625314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.625760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.626176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.766951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:41.775069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-42ac77b0-8c37-4fc1-85a9-e8c296a0170c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.164238 Aug 30 04:19:41.776384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 49/102] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:41.837880 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.838537 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.844442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.844919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.845375 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.846059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.846527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.846942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.992972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.005597 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.006309 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.007211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.007332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.008489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a52ca246-1a4b-4092-b665-1cfb68197d4e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.174666 Aug 30 04:19:42.009353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 54/103] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:42.015852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.016598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.017487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.018411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.019198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.019951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.194413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.199394 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.204238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.206046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-882e99ac-87b7-412e-b42d-4df79dfb9ba9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.206558 Aug 30 04:19:42.207016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 50/104] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:42.215512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.216172 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.216754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.217613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.218207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.218787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.399760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23aaf8c2-d8be-49ca-a496-4d9713c03f46", "name": "network-vif-plugged", "status": "completed", "tag": "9a8ac484-1ffe-4f46-8407-35f8d0244af1"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:42.409737 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.410219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.410666 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.422043 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] Creating event network-vif-plugged:9a8ac484-1ffe-4f46-8407-35f8d0244af1 for instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 on hv-cinder-85220 Aug 30 04:19:42.427009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-28785b5a-6961-4806-bb5f-926e168243ca req-ea899f3d-5e1a-4553-a52a-5104440c77ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095263 Aug 30 04:19:42.427605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 51/105] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:42.434982 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.442708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0c1ad8f8-b93f-429e-bd20-21574296f3ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.249567 Aug 30 04:19:42.443274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 55/106] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:42.796894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.797609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.804384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.805121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.805558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.806929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.807623 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.808200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.963333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.980798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7beaf5ad-b905-434c-a7f5-f5fc68cf04f9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.188024 Aug 30 04:19:42.982034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 52/107] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:43.035903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.036908 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.049557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.050046 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.050696 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.051568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.052183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.052609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.228860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.229800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.237677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.239218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.239947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.244433 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.245812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.248316 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.295285 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.307377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.311911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.313935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cb81ffdf-bba6-4c25-8533-a77455375429 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.282700 Aug 30 04:19:43.315511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 56/108] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:43.468092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.470636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.497900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.499495 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.500366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.505815 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.507015 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.512884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.574479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.584734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6bd51f65-3591-4fcc-a6e3-eb1bf760f2a1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.358117 Aug 30 04:19:43.609487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 53/109] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:44.003104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.004622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.008442 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:44.014322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.015451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.016423 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.017780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.018551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.019677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.223710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.234859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cedbe71b-ac5a-4d7c-a1ed-c99f9a66463c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.235736 Aug 30 04:19:44.235445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:44.321065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.338448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6f5fb302-51c6-404a-848d-1f4be80b174e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.877624 Aug 30 04:19:44.339550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 57/111] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:44.345526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.346294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.352839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.354119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.354847 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.355648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.356170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.356782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.603852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.607011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.607904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.614206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.615113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.615866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.616018 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.616398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.617631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.617961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-92fb3899-75e5-4cf1-9522-c3a583c39837 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.276493 Aug 30 04:19:44.618342 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.618833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 55/112] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:44.619694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.789106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.798534 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b89e3fab-7a76-4dee-bae2-ce6fc8ed8c70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.196557 Aug 30 04:19:44.811213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 58/113] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:45.255675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.256769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.265591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.266205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.266845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.268118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.268621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.269136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.362500 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.363452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.374457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.378194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.378661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.379412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.382768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.382768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.443745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.458363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a7250e3e-14c9-4f8b-b48c-0b68e64142e8 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.206376 Aug 30 04:19:45.458967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 56/114] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.578279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.587111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-63ee1a60-6562-426c-92f8-d5c44c39bf33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.230498 Aug 30 04:19:45.588633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.643456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.644730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.652923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.653839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.654737 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.655656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.656291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.656873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.830295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.832514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.850800 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.853643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.854715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.855759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.856332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.856955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.907283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.922870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.924350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.926218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-96fd5379-2619-4f1d-a496-55e6f55b3f15 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.288194 Aug 30 04:19:45.926812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 57/116] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:46.076773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.084529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c9addc2d-a360-494e-a441-c3e3d9929e2d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.262804 Aug 30 04:19:46.098824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 60/117] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:46.480489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.481091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:46.489617 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.492920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.494347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.497527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.498747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.499336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.610614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.611514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:46.625324 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.625819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.626340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.628768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.629425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.630041 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.733764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.752655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3c9c5005-10c6-4ef0-bf2f-4f038f709bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.276097 Aug 30 04:19:46.754298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 58/118] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:46.890944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.899603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-333bfec8-d2f6-431c-b2dd-ac828421acae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.293657 Aug 30 04:19:46.900841 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 61/119] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:46.933544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fde664c-f504-436a-bc03-41126ce28efe", "name": "network-vif-plugged", "status": "completed", "tag": "df23e2a1-bcf8-455e-aa83-acb143334ab7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:46.950463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.950940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.951416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.952091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.954569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:46.964150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] Creating event network-vif-plugged:df23e2a1-bcf8-455e-aa83-acb143334ab7 for instance 5fde664c-f504-436a-bc03-41126ce28efe on hv-cinder-85220 Aug 30 04:19:46.971528 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-f58c05da-aea8-484d-abd0-d1a879940c6b req-3d8b8869-6508-466d-ab5d-e943e1a29104 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041792 Aug 30 04:19:46.972014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.972502 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.972632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 59/120] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:46.972922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.973615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.974055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.974488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.106447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.107369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.115226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.115967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.116291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.117278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.117878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.118497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.148822 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.167762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.169223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.170565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6963fc4d-3a96-4b26-b273-81ca8e76ec7d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.225167 Aug 30 04:19:47.171337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 62/121] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:47.291494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.299488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0e3ce993-3b57-4335-be29-20e8051a9f85 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.198359 Aug 30 04:19:47.300067 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 60/122] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:47.776027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.776628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.785424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.785904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.786580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.788680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.789470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.792660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.922057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.923303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.935249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.935788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.938728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.939685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.941712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.943225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.170293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.186102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-859bf12b-2691-4f92-bce5-c395a61edc6c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.264484 Aug 30 04:19:48.199595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 61/123] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:48.199595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.199595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.207916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.209290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.210225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.211175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.211827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.213001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.261234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.279611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ed9a76bf-dd3f-4be1-b849-2b9d4aa327ac tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.507927 Aug 30 04:19:48.281878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 63/124] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:48.324897 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.325757 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.334101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.334631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.335051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.336867 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.338204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.338981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.411108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.421783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.423341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.435651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7c08029b-e643-4d0c-99f1-20d90384c365 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.235300 Aug 30 04:19:48.436852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 62/125] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:48.594137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.609112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-66b10298-c638-4682-ac56-02a87c3a315c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.291061 Aug 30 04:19:48.610411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 64/126] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:49.214949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.215725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.224037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.224669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.225315 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.226074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.226940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.227458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.248890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:49.301846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.302650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.320810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.322169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.322788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.323948 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.324555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.325291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.412239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.422841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d0052886-eef3-4092-a2bb-a5c890753542 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.216489 Aug 30 04:19:49.434664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 63/127] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:49.460944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.461554 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.470800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.471452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.474173 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.476013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.478530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.479455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.531118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.541715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61a7a632-fc1b-4dca-bf74-d7d8930ee5a3 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1314 microversion: 2.1 time: 0.242786 Aug 30 04:19:49.542772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 65/128] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:49.631437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.632306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.640155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.644070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.645047 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.649492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.650858 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.651447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.702501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.715337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.717750 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.719114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-26a30280-3b88-4601-a7bc-9521534333f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.263169 Aug 30 04:19:49.719850 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 64/129] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:49.893173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.905472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5305723d-d674-4edc-9cd4-c368b6c09e8d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.278424 Aug 30 04:19:49.906138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 66/130] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:50.447614 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.448300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.454598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.455171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.455605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.456315 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.456747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.457165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.565979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.566734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.574914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.575165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.575664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.577167 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.577258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.577617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.653197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.692084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-46469d76-5a6d-4e6a-ad90-7c9de546fd51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.248264 Aug 30 04:19:50.692868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 65/131] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:50.743608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.747588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.756771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.757828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.758606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.759773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.760586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.761196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.776498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.799462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d2c8346b-0682-4e14-a5dd-d6642625ce24 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1500 microversion: 2.1 time: 0.237040 Aug 30 04:19:50.800128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 67/132] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1500 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:50.928067 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.929468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.939391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.940348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.941092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.942445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.944600 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.945222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.987513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.997294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.999231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.000513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c04a643f-4fd5-4895-b5a5-ab0dbf92e783 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.260850 Aug 30 04:19:51.001225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 66/133] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:51.163515 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.172336 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dbdd216c-a581-4c4e-bfe6-0643b3b073c9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.248927 Aug 30 04:19:51.186744 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:51.713747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.723590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.732590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.733081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.733569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.734267 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.734692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.735131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.876664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.886951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cca62ff4-c42e-4103-8dd9-342872d02b32 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.177726 Aug 30 04:19:51.887920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:52.024382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:52.025059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:52.031161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.031635 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.032056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.033137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.033743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.034219 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.197198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:52.197970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:52.204866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.205465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.206034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.206942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.207492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.208005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.215797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:52.232027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:52.237398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:52.239443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:52.241181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ea61d742-6c1c-4961-8de6-3a9e332603aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.220768 Aug 30 04:19:52.243016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 69/136] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:52 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:52.505117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:52.514339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8712904e-93da-462e-8106-6864fa117dfe tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.322560 Aug 30 04:19:52.517323 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 68/137] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:52 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:52.908209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:52.908577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:52.915143 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.916386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.916927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:52.918031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:52.918567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:52.918924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.269684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.270489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.278705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.282702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.283190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.287022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.288092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.292279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.292994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.298476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c86934c0-d05e-447b-bfee-96fdd8776781 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.390437 Aug 30 04:19:53.311094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 70/138] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:52 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:53.531962 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.539809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc346a01-d81b-4a79-ad29-5f6264de931a"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:53.543260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.544622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.546401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.547864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e09d494-d1f6-48c5-a198-50f26375a65b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.285012 Aug 30 04:19:53.549041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 69/139] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:53.562901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.563763 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.566418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.567047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.567163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.567641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.568138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.568258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.590868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.591357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.591790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.592479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.592927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.593338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.803203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.826671 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d768cb5b-cb33-4bd9-8920-fe408987ae77 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.276378 Aug 30 04:19:53.827250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 70/140] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:54.321313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.325558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.328593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.329075 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.329506 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.330192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.330677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.331097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.484976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.500986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-27ff6503-c41d-4d5b-b31a-3dd2058a19b4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.183395 Aug 30 04:19:54.501684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 71/141] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:54.571022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.572635 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.579808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.580680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.581321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.582239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.583063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.583686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.773366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.784010 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.785448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.787153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-418e0935-7132-4e8b-a3c1-490ab10ffd88 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.219670 Aug 30 04:19:54.787897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 72/142] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:54.848426 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.849141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.852515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:54.857722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.858534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.859154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.860120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.860780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.861399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.023904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.033496 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8deccdb-98ff-4900-b17b-5ce7e6601d88 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.189382 Aug 30 04:19:55.034398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 73/143] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:55.523227 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.523888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.531441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.532292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.533137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.533848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.534588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.535021 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.699417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.707284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d8381d9e-ff61-42c2-818b-3c83bd668c75 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.187880 Aug 30 04:19:55.708031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 74/144] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:55.727788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67620860-4433-443f-9ed6-f67a98bf44cf", "name": "network-vif-plugged", "status": "completed", "tag": "84574c99-3886-4ef8-b113-d17a2f4ac835"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:55.737922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.738423 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.738844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.757071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] Creating event network-vif-plugged:84574c99-3886-4ef8-b113-d17a2f4ac835 for instance 67620860-4433-443f-9ed6-f67a98bf44cf on hv-cinder-85220 Aug 30 04:19:55.763618 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-010dafa6-fbb6-432a-9ca3-c876b38dac07 req-91af30dd-d34b-453d-86e5-4cb58f11c399 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039240 Aug 30 04:19:55.764231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 75/145] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:55.812192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.812888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.823020 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.824082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.824329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.825305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.826036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.826478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.989373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.998669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:56.000248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:56.001356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-55e33ac0-9ca2-413d-aeb2-0de48bc2afdc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.194952 Aug 30 04:19:56.002070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 76/146] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:56.054844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:56.055448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:56.062034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.062549 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.062984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.063673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.064121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.064544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.197139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:56.204385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-60cd9a87-cfed-40ac-b8bb-953875ec042c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.153381 Aug 30 04:19:56.204956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 77/147] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:56 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:56.454240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83d818a5-af98-4cc0-8cf8-72f32a245bd6 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "POST /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.920365 Aug 30 04:19:56.455003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 71/148] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:19:53 2022] POST /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46/os-volume_attachments => generated 194 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:56.729599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:56.730163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:56.736097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.736570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.736986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.737653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.738089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.738521 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.887055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:56.895351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-724b44d1-8648-4707-8007-14121163a728 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.170199 Aug 30 04:19:56.895923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 78/149] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:56 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:57.026762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.027369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.033838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.034420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.034846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.035529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.036052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.036494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.187128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.195408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.197448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.199283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e196a19-8fb3-46a3-a105-64e13cfc18c9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.178225 Aug 30 04:19:57.200142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 72/150] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:57.230487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.231098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.237432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.237870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.238312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.238999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.240029 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.240558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.394221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.406091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f0aae5fa-032d-429f-9586-caa56cfd5c3e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.182891 Aug 30 04:19:57.406923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 79/151] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:57.809030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa060fe-649e-4f72-9288-d7d92a36e037", "name": "network-vif-plugged", "status": "completed", "tag": "b8e75002-6c9d-47c3-a24b-44a2b69a1fc6"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:57.821576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.823208 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.823643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.835364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] Creating event network-vif-plugged:b8e75002-6c9d-47c3-a24b-44a2b69a1fc6 for instance daa060fe-649e-4f72-9288-d7d92a36e037 on hv-cinder-85220 Aug 30 04:19:57.840715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-d1943068-4d7f-4b7e-8c80-c4f1b03cce0d req-491cdc4f-6d60-4673-a76b-59c70e1592c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Aug 30 04:19:57.841317 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 73/152] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:57.916843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.917450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.923383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.923851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.924272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.924942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.925383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.925793 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.060428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.063939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:58.069181 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8bc6da9e-19de-4463-aeef-6bd1b8d52835 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.156193 Aug 30 04:19:58.069753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 80/153] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:58.225786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.226672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:58.233702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.234179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.234794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.235514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.235964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.236377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.392334 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.402574 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.404365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.405716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-00e9ea31-db27-46fb-abb7-233a3926fdb7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.184299 Aug 30 04:19:58.406408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 74/154] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:58.430710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.432535 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:58.440997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.441496 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.442072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.443330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.443798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.444207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.584785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.599502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7438033a-b5ec-4f00-969a-270d777d5edc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.174872 Aug 30 04:19:58.600228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 81/155] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:59.090381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:59.090991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:59.096935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.097433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.097915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.098631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.099104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.099520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.235241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.245076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-263948f7-6fdc-44f3-94d6-52bc46f3bc2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.158745 Aug 30 04:19:59.245671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:59.428491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:59.429122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:59.435810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.436281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.436705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.437378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.437830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.438219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.571525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.580337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.581817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.583028 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e2ffbd17-5575-4ce5-9b93-954fce08913b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.158414 Aug 30 04:19:59.583672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 82/157] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:59.625160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:59.625777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:59.632536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.633027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.633490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.634721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.635278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.635913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.861929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "name": "network-vif-plugged", "status": "completed", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:59.866103 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.877614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c771649-2983-48c1-98fa-699d8c279a72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1322 microversion: 2.1 time: 0.257265 Aug 30 04:19:59.878378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 76/158] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:59.882388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.883250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.884005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.898517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] Creating event network-vif-plugged:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:19:59.904063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-11ecbc36-6083-4b64-8659-a300df13d7fd req-b9385a2f-b9af-4826-b238-4b41f19485bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046236 Aug 30 04:19:59.904965 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 83/159] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:00.266563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.267380 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.273922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.274418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.275557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.276260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.276703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.277112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.403787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.411311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-99d0a24c-7a62-4638-9b31-2026ce163543 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.148809 Aug 30 04:20:00.411866 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 77/160] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:00.607681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.608530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.614899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.615366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.615784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.616452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.616886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.617292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.750351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.758802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.760817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.761916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9fd5a15c-1ce7-4105-82af-50e3c0d2033c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.158993 Aug 30 04:20:00.762533 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 84/161] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:00.906155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.906957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.909211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=73 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:00.927045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.927434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.927873 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.931430 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.931980 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.932417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.269245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.277099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-35b860e9-d051-4b97-b45c-f3547780a3cf tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1516 microversion: 2.1 time: 0.380298 Aug 30 04:20:01.277665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 78/162] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:01.298517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:01.301003 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:01.307884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.308364 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.308792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.309487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.309931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.310377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.380932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'flavor' on Instance uuid 67620860-4433-443f-9ed6-f67a98bf44cf {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:20:01.432550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:01.433147 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:01.438953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.439426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.439845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.440512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.440949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.441359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.495382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4e672c1f-5dbc-4bcb-b05a-324881b47df4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf/action" status: 200 len: 32 microversion: 2.1 time: 0.200774 Aug 30 04:20:01.496000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 85/163] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:01 2022] POST /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:20:01.505605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:01.506320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:01.513282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.513762 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.514196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.514916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.515391 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.515812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.574544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.582294 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6b41843d-90a0-4ee8-88c0-947fb92cb9d9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.154052 Aug 30 04:20:01.582967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 79/164] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:01 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:01.652440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.660257 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-97c67e6d-e8dd-4f5c-9dce-68b22c6f8f53 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.158697 Aug 30 04:20:01.660835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 86/165] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:01 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:01.784442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:01.785085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:01.791577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.792059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.792492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.793178 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.793630 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.794044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.941001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.954647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.956375 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:01.957738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fd4a6585-8a56-417a-ac5f-8278e2a973d6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.177206 Aug 30 04:20:01.958430 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 80/166] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:01 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:02.604237 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.604844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.612383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.613215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.613861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.614783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.615449 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.616019 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.683538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.684831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.693186 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.693685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.694207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.699729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.700211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.701130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.799516 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.816818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e5a7131d-73a1-41d9-a4b0-e7ee817ed8bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.216929 Aug 30 04:20:02.818260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 87/167] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:02.920017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.928139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2a606eb0-011c-4cd4-b9d7-abc54486162f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.250513 Aug 30 04:20:02.928711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 81/168] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:02.981612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.982269 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.988747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.989226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.989651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.990370 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.990817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.991232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.138224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.146427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.147856 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.148971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-87c69ab4-48f4-4c5f-931d-3ac6a6596f3e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.172057 Aug 30 04:20:03.149522 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 88/169] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:03.838923 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:03.839524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.845338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.845803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.846224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.846914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.847350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.847787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.949121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:03.949735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.955701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.956175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.956603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.957363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.957731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.958150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.984226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.991955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3db06958-f43e-4f63-9274-d083dc6d0324 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.157465 Aug 30 04:20:03.992528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 82/170] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:03 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:04.098476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.106178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2688323b-2517-482a-a9ab-3ba3f6035e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.161019 Aug 30 04:20:04.106780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 89/171] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:03 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:04.171915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.172515 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:04.178332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.178806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.179230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.179901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.180344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.180760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.311121 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.319146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.320589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.321722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2fec3e22-3b75-4f75-9028-5efbd7b2c4bf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.153642 Aug 30 04:20:04.322307 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 83/172] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:05.013034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.013639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.019992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.020472 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.020901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.021685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.022136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.022492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.126538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.127106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.135474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.135991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.136452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.137242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.137561 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.138149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.154599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.162977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-24411b0f-04f7-4888-80e9-c6a280cc3c5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.154008 Aug 30 04:20:05.163544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 90/173] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:05.270526 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.279074 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d1473c6b-0cdf-46de-998c-1c037727fd7b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.156403 Aug 30 04:20:05.279644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 84/174] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:05.344398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.345006 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.350948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.351419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.351863 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.352517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.353573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.353990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.483932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.492040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.494943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.495384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-42c1e258-d1c7-4768-b633-ca072cf9eba9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.154920 Aug 30 04:20:05.495949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 91/175] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:06.183459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.184070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.190540 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.191002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.191431 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.192544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.192544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.192944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.318142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.319148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.326068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.326958 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.327461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.328349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.328888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.329526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.480753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.492860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-49ca4765-d84d-4c00-965d-7d7b9cd28bf9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.190047 Aug 30 04:20:06.494331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 92/176] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:06.501426 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.503137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.504538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.509584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:06.513195 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.513851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.514305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.515072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.515596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.516240 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.516446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f17c4fd1-3e4e-473d-a351-e6c5871548bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.336438 Aug 30 04:20:06.517357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 85/177] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:06.522670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.523568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.531380 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.531954 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.532391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.533087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.533532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.533946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.562407 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:06.675863 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b0da386a-2136-41e1-9f56-33b7e0cd03d4 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 204 len: 0 microversion: 2.1 time: 0.179784 Aug 30 04:20:06.679175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 93/178] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:06 2022] DELETE /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:06.689173 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.690222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.698241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.698886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.699507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.700767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.701230 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.702071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.710171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.724341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:06.732612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.745712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.748035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f8e255e9-1d30-4377-8720-18e2b190a921 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.229178 Aug 30 04:20:06.749284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 86/179] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:06.880734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.893231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-792a19a4-8c46-4894-8fe4-73e0f3d97963 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.208486 Aug 30 04:20:06.893822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 94/180] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:07.516124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.516750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.523511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.523989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.524424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.525929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.526440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.526865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.544460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.545066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.551094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.551576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.552007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.552697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.553140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.553558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.668972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.680296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-01b74d33-0365-4854-9840-256e4d84ebce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.168048 Aug 30 04:20:07.681395 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 87/181] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:07.692663 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.701175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fcd2e669-b339-4b60-a85e-f54b18cdc44a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.161593 Aug 30 04:20:07.701752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 95/182] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:07.778184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.778730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.784613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.785085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.785512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.786217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.786675 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.787093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.916216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.917279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.917880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.925412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.927199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.927399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.928031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.928618 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.928741 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b5d4cc1f-f348-4545-9d29-2cad3e7bbe09 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.155048 Aug 30 04:20:07.929525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.930129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.930581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.942845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 88/183] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:08.087798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.096636 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1154f9e3-1ee6-4ce2-b29a-e1da6a649e91 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.183762 Aug 30 04:20:08.097606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 96/184] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:08.701857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:08.702505 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:08.708870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.709350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.709777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.710493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.710945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.711364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.722367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:08.723218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:08.730764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.731337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.731839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.732605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.733189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.733844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.867390 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.876631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b7b636ac-871d-4267-bf3d-066f66ea136c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.178311 Aug 30 04:20:08.877198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 89/185] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:08 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:08.890054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.898381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1cbaa2bc-52b6-422e-85f4-cb8298c82746 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.179877 Aug 30 04:20:08.898971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 97/186] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:08 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:08.951760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:08.952438 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:08.959795 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.960408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.960983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.961736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.962474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.962916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.095809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.104731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.106194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.107312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fc5b5f3b-5886-48ce-8994-9703d0ec7509 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.160439 Aug 30 04:20:09.108157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 90/187] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:08 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:09.118221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.119134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.124847 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.125320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.125819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.126462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.126908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.127501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.262994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.272101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a1c97a79-a7d2-4543-b50f-40ac4a17c7b9 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.157596 Aug 30 04:20:09.272982 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 98/188] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:09.897830 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.898541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.905568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.906132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.906586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.907346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.907700 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.908110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.923536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.926583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.933837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.934463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.934794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.935546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.936088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.936527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.073200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.080102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.081440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-654a98b0-1400-48c7-948f-8bfac931f27a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.163575 Aug 30 04:20:10.093158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 99/189] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:10.093343 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-59858ba4-37ec-40ab-8e3e-3b182d53216e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.195060 Aug 30 04:20:10.093343 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 91/190] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:10.128933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:10.129638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:10.137238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.137796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.138363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.139063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.139513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.139935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.279225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.287954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.289867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.292361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-22a9b00f-ddf1-4784-b1f8-e48ceca1983a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.167314 Aug 30 04:20:10.293104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 100/191] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:10 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:10.295306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:10.295886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:10.302028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.302534 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.302966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.303650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.304097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.304521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.459550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.468030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3fd834b4-69ea-4d32-a31b-a3de0e2ba03a tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.178060 Aug 30 04:20:10.468605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 92/192] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:10 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.103550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.104235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.110859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.111523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.111952 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.112635 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.112889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.113329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.113583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.113692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.120688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.121252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.121747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.122541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.123061 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.123564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.255648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.264593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d28c735d-f8a8-4758-aa8b-fba41f6738a7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1363 microversion: 2.1 time: 0.164526 Aug 30 04:20:11.265324 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 101/193] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.285278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.293164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94160c5a-8601-4ed1-b542-ef697478c300 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.184247 Aug 30 04:20:11.293739 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 93/194] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:11.316932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.317524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.324616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.325161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.325587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.326285 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.326752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.327195 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.477318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.489190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.489791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.495515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.496891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.497172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.497405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.497837 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.498306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-877ecaa5-8546-400c-b1e2-37f8cc2360bd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.185257 Aug 30 04:20:11.498587 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.498872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 102/195] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:11.499223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.499645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.632041 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.640668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e4859156-7622-4494-b5ac-399a1902421f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.155231 Aug 30 04:20:11.641614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 94/196] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:12.287145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.287755 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.294407 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.294823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.295254 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.295975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.296426 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.296846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.314507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.315235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.322718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.323209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.323642 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.324524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.324974 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.325575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.452546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.461357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aca13181-32a0-4123-8c73-74fcc4604f9f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1548 microversion: 2.1 time: 0.178460 Aug 30 04:20:12.462405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 103/197] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:12.483317 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.491463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.491944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.492694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d869373e-2848-46e2-91c7-0918ee3a74f3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.182083 Aug 30 04:20:12.494098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 95/198] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:12.498241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.498910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.499502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.500352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.500975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.501387 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.525629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.527363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.533464 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.533949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.534412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.535107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.535555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.535972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.585229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9d849d7c-4315-47c5-979d-91e7e4ed27e2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097543 Aug 30 04:20:12.585861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 104/199] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:12.662067 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.662794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.675808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.679214 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.680021 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.681205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.681622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.682060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.692685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.708005 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.713939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.723546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0e7db920-678d-4a6a-b816-cdbfcc16d9c5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1407 microversion: 2.20 time: 0.202945 Aug 30 04:20:12.724236 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 96/200] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:13.189177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.200120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c6836534-5ea0-4f83-a8ae-caee991a06d5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.542257 Aug 30 04:20:13.200712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 105/201] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:13.514583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.515275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.522292 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.522874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.523373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.524144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.525252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.525729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.752667 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.754092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.764392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.765355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.766283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.767576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.768376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.769129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.808107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.820589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-63b6cab4-1f02-4369-858f-573edf8e36f4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.310028 Aug 30 04:20:13.823016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 97/202] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:14.019217 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.029068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.030671 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.032009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-64bbbd51-edd1-4303-a60f-b5f5e1032e50 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1599 microversion: 2.20 time: 0.284544 Aug 30 04:20:14.032961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 106/203] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1599 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:14.072593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.073316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.081009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.081916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.082572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.083645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.084971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.085555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.223787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.224379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.230832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.231520 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.232095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.232937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.233530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.234102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.346510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-241f0014-79e2-406e-b0f8-24cbc30259a5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.282220 Aug 30 04:20:14.356418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 98/204] 10.222.0.46 () {60 vars in 1316 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:20:14.759807 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.774152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-784f7b85-f2c3-4a44-b6aa-b8171548285f tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1552 microversion: 2.1 time: 0.548655 Aug 30 04:20:14.781859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 107/205] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1552 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:14.803191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa060fe-649e-4f72-9288-d7d92a36e037", "tag": "b8e75002-6c9d-47c3-a24b-44a2b69a1fc6"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:14.820824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.822864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.823468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.844708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.845681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.857814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.865157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] Creating event network-changed:b8e75002-6c9d-47c3-a24b-44a2b69a1fc6 for instance daa060fe-649e-4f72-9288-d7d92a36e037 on hv-cinder-85220 Aug 30 04:20:14.866283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.866742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.867477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.867925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.868376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.872052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-80d5b2ed-4233-450a-9ccf-f258b80aea0a req-6d2c08b6-353d-492b-a3c4-48ac98e381e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077322 Aug 30 04:20:14.873276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 99/206] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:15.045363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.053742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-be4516f0-154d-42e1-b125-933a2cebb797 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.213191 Aug 30 04:20:15.054356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 108/207] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:15.815795 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:15.816509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:15.826580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.826580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.826835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.829838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.830350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.830971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.936686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.947569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8155473-73cc-4e4d-b0f5-5c4cb5bb5fa5 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1510 microversion: 2.1 time: 0.144660 Aug 30 04:20:15.948314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 100/208] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:15 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:15.953716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23aaf8c2-d8be-49ca-a496-4d9713c03f46", "name": "network-vif-deleted", "tag": "9a8ac484-1ffe-4f46-8407-35f8d0244af1"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:15.988593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.989335 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.990236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.008849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] Creating event network-vif-deleted:9a8ac484-1ffe-4f46-8407-35f8d0244af1 for instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 on hv-cinder-85220 Aug 30 04:20:16.029636 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-81852e1e-4e94-4edb-af11-cab31ccd700d req-229b371e-fb2f-47d9-bab4-8260c0218f58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081564 Aug 30 04:20:16.030583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 109/209] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:20:16.075670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:16.076264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:16.082737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.083218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.083643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.084589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.085192 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.085602 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.357672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.365518 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cd3155bd-0390-4912-a1ab-3af20e55baf6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.293706 Aug 30 04:20:16.379182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 101/210] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:16 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:16.974208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:16.974994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:16.982763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.983921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.984574 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.985494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.986145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.987211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.058014 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.070484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bd797eee-cdb0-40ec-9554-cd07e7475171 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1510 microversion: 2.1 time: 0.098855 Aug 30 04:20:17.078894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 110/211] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:16 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1510 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:17.390915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:17.391522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:17.398469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.398944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.399372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.400785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.401233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.401724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.537589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.545857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e929da65-628a-4732-9000-a982c73a7458 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.158663 Aug 30 04:20:17.546565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 102/212] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:17 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:18.098760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.099421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.103263 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:18.108939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.110705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.111389 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.111848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.112300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.112713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.114895 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.115729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.116357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.130638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] Creating event network-changed:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:20:18.137188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-31697a75-1d6f-47f4-ae29-970a8b6f393f req-fb5cd1bd-c4aa-40b5-9f16-72299989080a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041872 Aug 30 04:20:18.138630 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 103/213] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:20:18.178469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.187284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-445ec67a-9de2-4403-8aad-c9f0a5bd5605 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1345 microversion: 2.1 time: 0.098273 Aug 30 04:20:18.194622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 111/214] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:18.568206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.569512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.577955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.578584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.579132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.579945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.580558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.581618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.587809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:18.811406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.819151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d0e8b13c-146a-4575-9eaf-b82c36675e58 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.256232 Aug 30 04:20:18.819853 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 104/215] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:19.209174 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:19.209792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:19.217204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.217694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.218124 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.218845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.219299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.219890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.226282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:19.257127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.257604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.258039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.258502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lazy-loading 'fault' on Instance uuid 23aaf8c2-d8be-49ca-a496-4d9713c03f46 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:20:19.305865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:19.328034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-04f96f83-af4d-4397-b48f-5758ef78f284 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1350 microversion: 2.1 time: 0.122973 Aug 30 04:20:19.334223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 112/216] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:19 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:19.847144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:19.847741 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:19.854327 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.854799 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.855223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.855897 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.856334 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.856750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.991221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:19.999128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e3489c41-e7c9-4a5a-83ac-06047f41d39b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.155702 Aug 30 04:20:19.999708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 105/217] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:19 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:20.350483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.352131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.360108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.360668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.361526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.362273 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.362714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.363167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.397829 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.398518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.399162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.399783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lazy-loading 'fault' on Instance uuid 23aaf8c2-d8be-49ca-a496-4d9713c03f46 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:20:20.449860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:20.459198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5938086a-e65b-4610-9a69-7225ff28a4f0 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1350 microversion: 2.1 time: 0.112408 Aug 30 04:20:20.459779 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 113/218] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:21.019811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.020423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:21.026867 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.027353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.027787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.028477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.028925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.029345 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.167587 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:21.176006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8df30fff-4342-4de3-b10a-ec1d4afaccd8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.160102 Aug 30 04:20:21.176802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 106/219] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:21.481666 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.482274 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:21.489366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.489366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.490279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.490279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.490555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.491747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.526773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.527241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.527662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.528398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lazy-loading 'fault' on Instance uuid 23aaf8c2-d8be-49ca-a496-4d9713c03f46 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:20:21.571747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e68c885560485ead1c61fe83fc3ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe278e07fd7940dca53f7c2b8b792326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:21.580188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-40e8a4fc-2d06-42ca-b618-186ac2d95d64 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 200 len: 1350 microversion: 2.1 time: 0.103184 Aug 30 04:20:21.580767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 114/220] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:22.197633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.198916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.205371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.206072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.206873 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.207817 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.208509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.209118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.391596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.400161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-615849e4-eb23-46af-8a44-07ab4c4b9153 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.205964 Aug 30 04:20:22.400946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 107/221] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:22.601294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.601928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.609004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.609361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.609827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.610590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.611032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.611442 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.626223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] HTTP exception thrown: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Request method failure captured: Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 HTTP/1.1 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-8L58e2PK62GNsK2Pmx6agOQYXo5XPLKOlcE4iLIFeLzl1_UEHGhAgkbM2FniyzRxAhDffiMMovmr_Rr-QUlc0OkrnXMpLfqe0PoBRaq6VmLLTlVEexO2XU4BNvX1t8n9q1EfvErrwMRBROBJ88spLeoTd1WJ6ViO17KwSv61YXiU Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:20:22.631289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b0e68c885560485ead1c61fe83fc3ce4 Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.633206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '23aaf8c2-d8be-49ca-a496-4d9713c03f46'} Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:22.635078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.636445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.637853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Returning 404 to user: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:22.637853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b6c4fda1-a24e-45a2-8e77-cb8444725a0c tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 404 len: 111 microversion: 2.1 time: 0.035407 Aug 30 04:20:22.637853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 115/222] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:20:22.756779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.762210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.777771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.778396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.778907 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.779981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.780378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.780903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.795955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] HTTP exception thrown: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Request method failure captured: Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46/os-volume_attachments HTTP/1.1 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-8L58e2PK62GNsK2Pmx6agOQYXo5XPLKOlcE4iLIFeLzl1_UEHGhAgkbM2FniyzRxAhDffiMMovmr_Rr-QUlc0OkrnXMpLfqe0PoBRaq6VmLLTlVEexO2XU4BNvX1t8n9q1EfvErrwMRBROBJ88spLeoTd1WJ6ViO17KwSv61YXiU Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:20:22.800415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b0e68c885560485ead1c61fe83fc3ce4 Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.801620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'server_id': '23aaf8c2-d8be-49ca-a496-4d9713c03f46'} Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:22.802348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:22.803423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:22.804477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Returning 404 to user: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:22.804477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f837f205-e6c2-42dd-b0de-ba9c3428caa2 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050645 Aug 30 04:20:22.804477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 108/223] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:23.423710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.424325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.430534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.431251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.431784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.432488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.432936 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.433355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.630970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:23.649624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1db322b9-a71d-4a0a-b814-88bd8ae2deb7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.230331 Aug 30 04:20:23.651499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 116/224] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:23 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:24.672119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:24.672729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:24.679615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.680091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.680508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.681329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.682053 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.682668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.823464 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.832632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e54855c2-1907-4047-8217-01bb725c5cac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.164385 Aug 30 04:20:24.833191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 109/225] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:24 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:25.854908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.855590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.858207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:25.863448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.864005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.864524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.865291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.865812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.866422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.000201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:26.011821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-541b19d0-eca3-490b-ab2e-a607da988e15 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.161099 Aug 30 04:20:26.012402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 117/226] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:27.033006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.033612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.041169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.041703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.042138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.043028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.043479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.043901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.190695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.200685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f5a073e5-ff01-4ce0-a288-fd1065c817e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.171491 Aug 30 04:20:27.201301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 110/227] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:27.208723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.209250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.215894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.216363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.216786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.217466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.217909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.218353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.232739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] HTTP exception thrown: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Request method failure captured: Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 HTTP/1.1 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-8L58e2PK62GNsK2Pmx6agOQYXo5XPLKOlcE4iLIFeLzl1_UEHGhAgkbM2FniyzRxAhDffiMMovmr_Rr-QUlc0OkrnXMpLfqe0PoBRaq6VmLLTlVEexO2XU4BNvX1t8n9q1EfvErrwMRBROBJ88spLeoTd1WJ6ViO17KwSv61YXiU Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:20:27.234276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b0e68c885560485ead1c61fe83fc3ce4 Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.235714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '23aaf8c2-d8be-49ca-a496-4d9713c03f46'} Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:27.236469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.237541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.238624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Returning 404 to user: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:27.238624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-961ebb13-0c81-4c16-831f-6212bc922d18 tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 404 len: 111 microversion: 2.1 time: 0.031034 Aug 30 04:20:27.238624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 118/228] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:27 2022] DELETE /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:20:27.244810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.245450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] [instance: 23aaf8c2-d8be-49ca-a496-4d9713c03f46] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.251659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.252140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.252568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.253354 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.253811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.254231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.269352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] HTTP exception thrown: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Request method failure captured: Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 HTTP/1.1 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-8L58e2PK62GNsK2Pmx6agOQYXo5XPLKOlcE4iLIFeLzl1_UEHGhAgkbM2FniyzRxAhDffiMMovmr_Rr-QUlc0OkrnXMpLfqe0PoBRaq6VmLLTlVEexO2XU4BNvX1t8n9q1EfvErrwMRBROBJ88spLeoTd1WJ6ViO17KwSv61YXiU Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:20:27.271612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe278e07fd7940dca53f7c2b8b792326"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: fe278e07fd7940dca53f7c2b8b792326 Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-DeleteServersTestJSON-47747043 Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b0e68c885560485ead1c61fe83fc3ce4 Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-DeleteServersTestJSON-47747043-project Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.272842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '23aaf8c2-d8be-49ca-a496-4d9713c03f46'} Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:27.273483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. Aug 30 04:20:27.274965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.276071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] Returning 404 to user: Instance 23aaf8c2-d8be-49ca-a496-4d9713c03f46 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:27.276071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8eb6b2b-cc14-4026-a8a2-dfc6c465e5ca tempest-DeleteServersTestJSON-47747043 tempest-DeleteServersTestJSON-47747043-project] 10.222.0.46 "GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46" status: 404 len: 111 microversion: 2.1 time: 0.032768 Aug 30 04:20:27.276071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 111/229] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/23aaf8c2-d8be-49ca-a496-4d9713c03f46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:28.223100 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:28.223883 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:28.234083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.234676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.235106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.235716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.240661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.241102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.412421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.425024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a705bd1a-914c-48bf-9a9f-b269e41800a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.205844 Aug 30 04:20:28.440383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 119/230] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:28 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:29.454598 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:29.454598 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:29.464138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.464636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.465069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.465791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.475399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.475399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.737152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:29.753682 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-96267b93-f193-4df1-8e34-d51fce3dc439 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.306160 Aug 30 04:20:29.755287 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 112/231] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:29 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:30.782471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:30.784284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:30.792851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.793991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.794687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.795724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.796445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.797107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:31.114141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:31.125088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-32f46db2-7175-46f3-a980-5dc9ef8f1116 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.348307 Aug 30 04:20:31.128514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 120/232] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:30 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:32.152507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:32.153202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:32.165009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=70 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:32.179796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:32.181688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:32.182436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:32.183591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:32.184491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:32.184924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:32.385727 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:32.394338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-635b3985-1102-4442-8219-a507af7dbceb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.247417 Aug 30 04:20:32.395166 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 113/233] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:32 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:33.417629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:33.418971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:33.428477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:33.429117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:33.429543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:33.430226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:33.430836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:33.431256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:33.594569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:33.604976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-86790447-5d40-433c-abd1-e7f391646eb6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.192362 Aug 30 04:20:33.605859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 121/234] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:33 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:34.627153 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:34.627876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:34.640490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.641239 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.641889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.643426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.644291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.644816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.785259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.793552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-77c849f0-5066-4ba9-9e80-90c59786238e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.170312 Aug 30 04:20:34.794119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 114/235] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:34 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:35.825584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:35.826192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:35.832070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:35.832613 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:35.833101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:35.833957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:35.834440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:35.834914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:36.017914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:36.026041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-42f1003e-0712-4713-b4a1-a5c5ea171725 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.211802 Aug 30 04:20:36.026674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 122/236] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:35 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:37.047075 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:37.047587 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:37.054052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.054578 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.055008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:37.056298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.056944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.057336 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:37.245871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:37.255583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0a73a193-544f-4980-8173-e037028518ea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.212357 Aug 30 04:20:37.261024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 115/237] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:37 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:38.280999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:38.285260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:38.304986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:38.308696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:38.309135 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:38.309863 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:38.310406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:38.310827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:38.458671 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.467376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30a9417e-87b8-4eda-beaf-340235b316b3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.190711 Aug 30 04:20:38.467963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 123/238] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:38 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:39.490406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:39.491148 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:39.499582 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.500100 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.500589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.501324 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.502199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.502649 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.669347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:39.677981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cab81cb9-a5c2-4506-a351-fbbf8c9228f6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.192424 Aug 30 04:20:39.678759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 116/239] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:39 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:40.705652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:40.706291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:40.714608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.715288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.715896 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.716755 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.717358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.718078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.872177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:40.880213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac0024d1-729a-4c8d-892c-322d36004615 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1522 microversion: 2.1 time: 0.181719 Aug 30 04:20:40.881122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 124/240] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:40 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:41.902478 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:41.903085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:41.909714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.910420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.910849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:41.911967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.912468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.913218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.049853 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.057456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c9d6403-4bc7-42c3-bb1d-76a2c9b6a980 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1502 microversion: 2.1 time: 0.159813 Aug 30 04:20:42.058036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 117/241] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:41 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:42.080491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:42.081314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:42.090118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.090629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.091065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.091766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.092519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.092948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.262000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.270412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cf5dc7e0-fb75-4f0e-a28f-45cc8b39409d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1516 microversion: 2.1 time: 0.194245 Aug 30 04:20:42.270993 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 125/242] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:42 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:43.755533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:43.759508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:43.769732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.770409 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.770829 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.771514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.772120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.772559 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.798059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'flavor' on Instance uuid 5fde664c-f504-436a-bc03-41126ce28efe {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:20:43.937009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4d99f11e-7dd4-4530-a4ea-bdb34eb85519 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/action" status: 200 len: 32 microversion: 2.1 time: 0.185859 Aug 30 04:20:43.937509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 118/243] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:43 2022] POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:20:43.948176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:43.948860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:43.955051 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.955742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.956337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.957211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.957861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.958310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.183074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:44.191514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-df7ac2a6-517e-4ee7-a8ef-1e36b694de70 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.248035 Aug 30 04:20:44.192318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 126/244] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:43 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:45.216661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:45.218104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:45.230062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.231184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.231663 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.232427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.232968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.233388 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.404489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.412837 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aaf6f313-73e0-45a1-bf10-1328aa46b03c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.201842 Aug 30 04:20:45.413885 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 119/245] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:45 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:46.435184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:46.436172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.443283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.443799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.444294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.445096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.445605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.446983 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.579655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:46.588258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-57a11015-3a17-42b0-917d-081fc71aedce tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.156725 Aug 30 04:20:46.588834 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 127/246] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:46 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:47.609260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:47.609912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:47.616217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.616753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.617186 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.618621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.619600 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.620094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.624392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:47.820525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.829983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f923b408-0b7f-4742-b0bd-1fd447125643 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.224536 Aug 30 04:20:47.830659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 120/247] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:47 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:48.854422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:48.855036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:48.861604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.862096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.862549 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.863250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.863702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.864122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.999979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.008277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6e0cda5b-b50c-420b-a62d-46a64825dae1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.160286 Aug 30 04:20:49.009321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 128/248] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:48 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:50.036743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:50.037591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:50.044623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.045110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.045553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.046268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.046914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.047333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.248451 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.269130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-91b741d9-442f-488b-8313-a53f30c70442 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.241049 Aug 30 04:20:50.269238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 121/249] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:50 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:51.292023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:51.292626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:51.298578 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.299042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.299465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.300139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.300577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.300987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.304936 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=99 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:51.457509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:51.466640 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7e12aa67-8ca9-43a4-9e39-0ce36d9ffa56 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.179118 Aug 30 04:20:51.467535 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 129/250] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:51 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:52.487772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:52.488381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:52.499056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:52.499391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:52.499821 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.500508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:52.500952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:52.501357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.643379 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:52.652701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a2dc0813-90b9-47a8-a1af-20966579ad54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.169077 Aug 30 04:20:52.653687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 122/251] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:52 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:53.675721 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.676330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:53.682657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.683265 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.683759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.684729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.685185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.685615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.835420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.845270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-83e8120a-a36b-4f95-a8cd-d6f1632d32de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.173580 Aug 30 04:20:53.845411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 130/252] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:54.865393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:54.865997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:54.872857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.873390 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.873803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.874533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.875070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.875520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.037193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:55.046118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61103895-3277-41f3-8ab7-cd7ba7b178e4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.184499 Aug 30 04:20:55.046889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 123/253] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:54 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:56.067642 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:56.068289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:56.070436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=28 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:56.077379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.077916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.078441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:56.079324 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.079836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.080325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:56.419090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:56.427144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4c66aabd-4795-4a7b-8152-e6679e32330e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.363303 Aug 30 04:20:56.427705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 131/254] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:56 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:57.448906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:57.450051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:57.456890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.457542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.458129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.458989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.459605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.460205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.679113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:57.690533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-522fb311-eb06-4d98-b40d-e95b79e41099 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.245260 Aug 30 04:20:57.691424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 124/255] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:57 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:58.716850 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:58.717643 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:58.724382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.724790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.725364 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.726242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.726710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.727130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.896794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.905487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d9dd227b-0a90-44a2-84b2-6000c6ca94a3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.192379 Aug 30 04:20:58.906193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 132/256] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:58 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:59.927844 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:59.929274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:59.937413 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.937977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.938511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.939632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.940172 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.940813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.184233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:00.193417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a721a609-19c5-461f-a450-dcbeddb8d685 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.269514 Aug 30 04:21:00.194146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 125/257] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:59 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:01.216984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:01.218183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:01.228898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:01.231042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:01.231497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:01.233383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:01.233940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:01.234806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:01.459047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:01.468540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-86df5028-16fb-4f61-8028-5380cfce2cc7 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.255270 Aug 30 04:21:01.469030 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 133/258] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:01 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:02.490731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:02.491576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:02.496291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=26 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:02.501462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.502314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.503938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.504619 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.505070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.505861 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.065017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:03.099088 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6a372c15-af1c-4139-9fc4-f00085e2cfac tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.591634 Aug 30 04:21:03.101052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 126/259] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:02 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:03.609394 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:03.609949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:03.629176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.629661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.630110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.631857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.631857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.632411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.671293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-028f7239-2ec8-4a92-a767-095034b95a08 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/ips" status: 200 len: 152 microversion: 2.20 time: 0.066462 Aug 30 04:21:03.673483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 134/260] 10.222.0.46 () {60 vars in 1289 bytes} [Tue Aug 30 04:21:03 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:21:04.122064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:04.123936 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:04.136270 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.137114 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.137619 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.138570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.139107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.139572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.371275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:04.382197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b21a6a08-849d-4b84-aea0-9a021b460fe0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1502 microversion: 2.1 time: 0.264740 Aug 30 04:21:04.405939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f417b09-fe15-475c-8e0e-4d6ccda29831"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:04.406616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 127/261] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:04 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:04.408462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:04.416083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.416577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.417452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.418401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.420011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.420831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.466974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] HTTP exception thrown: Cannot 'attach_volume' instance 5fde664c-f504-436a-bc03-41126ce28efe while it is in vm_state rescued Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Request method failure captured: Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/os-volume_attachments HTTP/1.1 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 74 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-3p5Xep934iUwstV6JMI33GcM9tIURT6ogzaAWeN5fk0Q5wgh518eMu_THo6zrtAvvhE_dKof3_P39EubOVwO19zOP-QfWiS5-N2d65ZFUuHk-ciiBUB8qQO4HQFeteyu83sL3yWom8ZXsFlRpxni7pXN5sPRWlsU0hzCY-3KXxuA Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:21:04.469430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: eb61948f41344ea481024a96cf03db37 Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {"volumeAttachment": {"volumeId": "5f417b09-fe15-475c-8e0e-4d6ccda29831"}} Aug 30 04:21:04.471009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Cannot 'attach_volume' instance 5fde664c-f504-436a-bc03-41126ce28efe while it is in vm_state rescued Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'server_id': '5fde664c-f504-436a-bc03-41126ce28efe', 'body': {'volumeAttachment': {'volumeId': '5f417b09-fe15-475c-8e0e-4d6ccda29831'}}} Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5fde664c-f504-436a-bc03-41126ce28efe in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:04.471918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5fde664c-f504-436a-bc03-41126ce28efe while it is in vm_state rescued Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:04.473056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5fde664c-f504-436a-bc03-41126ce28efe while it is in vm_state rescued Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Returning 409 to user: Cannot 'attach_volume' instance 5fde664c-f504-436a-bc03-41126ce28efe while it is in vm_state rescued {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-86458fea-68ed-4e2d-bb8c-1e4383345805 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069899 Aug 30 04:21:04.474118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 135/262] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:21:04 2022] POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:21:04.482171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:04.483333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:04.495445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.496891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.497353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.498064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.498999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.499503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.591871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6e25071b-a69e-4038-a8a9-32b1a798f7d8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/action" status: 202 len: 0 microversion: 2.1 time: 0.115323 Aug 30 04:21:04.596444 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 128/263] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:04 2022] POST /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:04.612162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:04.612768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:04.629282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.630076 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.630807 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.632055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.632706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.633961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.930006 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:04.938764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d883ede1-197e-45e8-8be0-da7ff108b586 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1510 microversion: 2.1 time: 0.341052 Aug 30 04:21:04.939375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 136/264] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:04 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:05.969827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:05.971278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:05.985841 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.986598 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.987545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:05.989142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.989758 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.990314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.256405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.271968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa9a3616-dba2-4865-8453-e20abed43e4f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1510 microversion: 2.1 time: 0.312491 Aug 30 04:21:06.274386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 129/265] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:05 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:07.295282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:07.296539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:07.312681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.316731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.317171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.319005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.322852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.323294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.632540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.647100 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b38747b5-4361-44ce-805e-e459bbb755de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1510 microversion: 2.1 time: 0.355716 Aug 30 04:21:07.648221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 137/266] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:07 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:08.187737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:08.188265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.196214 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.197348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.198011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.198974 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.199633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.200243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.246833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lazy-loading 'flavor' on Instance uuid a3ff227a-e878-4f20-b2e7-1d0fac6fb242 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:21:08.677134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:08.678691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.689178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.690120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.690938 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.692206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.693927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.694575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.895172 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9afb0bbf-ec69-434c-b278-4c488a1f96f9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/action" status: 202 len: 0 microversion: 2.20 time: 0.712815 Aug 30 04:21:08.897286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 130/267] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 30 04:21:08 2022] POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:21:08.913359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:08.914059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.927736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.928512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.929113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.930544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.931146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.932088 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.163909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.182564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4707cf91-fb4e-498c-94d9-23ecb147c18d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1516 microversion: 2.1 time: 0.516749 Aug 30 04:21:09.194476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 138/268] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:08 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1516 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:09.195259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.204335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.205794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.208531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edcae3ea-c3a3-4a0a-92a7-37065a1165ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.306479 Aug 30 04:21:09.209627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 131/269] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:08 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:10.235496 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.236087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.242979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.243568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.244220 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.244987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.245590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.245903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.497748 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.498523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.505211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.505694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.506125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.506855 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.507304 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.507722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.525887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.537993 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.539740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.541186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8234d453-eb77-47a1-bd7b-cd591389018a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.310586 Aug 30 04:21:10.541822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 139/270] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:10.549648 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3ce006f2-6599-42d5-a490-5754f048c031 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/ips" status: 200 len: 145 microversion: 2.1 time: 0.055849 Aug 30 04:21:10.550221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 132/271] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:10.769593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d713b4bf-f31d-4b2d-8cd5-171ca094573f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: .version_select at 0x7faa0d858af0>, body: {"keypair": {"name": "tempest-keypair-675997358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYH4EfIqHO1ouuJmZsKzmACyiqnn/zFw6p0iu/mFg8rCZx9KbUgPmAF4UMo5yfsM1/v6vV6ITfBPl5ggRNTZWoQ9XnA0xz86/RHhWbbxOXH4gscpc/3FjQLgowRuRTN9Q=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:10.791910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d713b4bf-f31d-4b2d-8cd5-171ca094573f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for project a9a5c650ed23445bb585711f962d7e09. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:10.796313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d713b4bf-f31d-4b2d-8cd5-171ca094573f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for user eb61948f41344ea481024a96cf03db37 and project a9a5c650ed23445bb585711f962d7e09. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:10.851977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d713b4bf-f31d-4b2d-8cd5-171ca094573f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086962 Aug 30 04:21:10.852992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 140/272] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:21:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:11.564944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.565544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.573226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.575654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.576290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.577033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.578759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.579209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.964344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.974527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.975983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.977734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d4a434a2-1c2c-4163-83a0-a807adb870f1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.416430 Aug 30 04:21:11.978132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 133/273] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:13.002733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.004468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.034870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.036288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.037050 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.037976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.038714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.047110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.200455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-293375059", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "524cda22-09e9-423b-b572-9d6bbb210043"}], "security_groups": [{"name": "tempest-securitygroup--416890496"}], "key_name": "tempest-keypair-675997358", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:13.449356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.460724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.463264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.478440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8394e5f3-821f-4018-b338-a3b575acdc68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.480607 Aug 30 04:21:13.484722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 141/274] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:12 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:13.494419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6055b1c8-4deb-4afd-9070-695a563ca5bd"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:13.500516 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.512080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.517514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.518099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] validate_networks() for [('524cda22-09e9-423b-b572-9d6bbb210043', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:21:13.518775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.520060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.520691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.521674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.078549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:14.079402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:14.080040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:14.080611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:14.081206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:14.093533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.094240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.094882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.095780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.096400 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.096991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.107850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:14.119312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:14.124658 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Getting quotas for user eb61948f41344ea481024a96cf03db37 and project a9a5c650ed23445bb585711f962d7e09. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:14.138688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:14.141468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:14.155090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c1916c89-455e-42c4-a5c4-ddcfa752a538 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668893 Aug 30 04:21:14.156486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 142/275] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:21:13 2022] POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:14.202347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d925e987-7ea8-4dba-86db-20c297e8d8cd tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.006190 Aug 30 04:21:14.203920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 134/276] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:21:14.220989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-66087378-930f-40c1-890d-d6314be39888 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.223099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-66087378-930f-40c1-890d-d6314be39888 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.321689 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-66087378-930f-40c1-890d-d6314be39888 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.330332 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-66087378-930f-40c1-890d-d6314be39888 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1244 microversion: 2.1 time: 0.119478 Aug 30 04:21:14.333166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 143/277] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:14.528096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.529332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.542871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.543818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.544516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.545586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.546337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.547106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.752835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.767657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.769939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.772173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-61385c7c-b5ef-4285-a5fd-b61e9443f470 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.248341 Aug 30 04:21:14.773949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 135/278] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:15.360643 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.361924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.377543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.380394 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.381116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.387145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.387881 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.388513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.518291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.538592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-dc2e816b-66a6-4780-a79b-ce0dc6df2770 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1296 microversion: 2.1 time: 0.186463 Aug 30 04:21:15.540032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 144/279] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:15.804120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.808386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.818070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.819308 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.819924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.821917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.823205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.824449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.095231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.106948 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.108627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.110496 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85f4bedd-e07f-4fee-935d-90c2e965dd2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.310481 Aug 30 04:21:16.114429 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 136/280] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:16.562451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.563739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:16.570790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.570790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.571257 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.571861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.572338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.572759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.690151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.699346 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-330f4f1c-4d37-4319-913d-85ec3cdcb27f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1296 microversion: 2.1 time: 0.141278 Aug 30 04:21:16.700772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 145/281] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:17.136378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.137002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.150703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.152031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.152636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.153528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.153977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.154613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.451498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.462977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.465860 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.467701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-15a05545-7f5d-4481-bd7f-79e065b9f016 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.337421 Aug 30 04:21:17.472169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 137/282] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:17.722274 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.723621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.733205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.733691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.734117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.743964 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.744443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.745070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.854443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.865228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0f59fc4f-819b-4dfb-b3a3-164e93ff9828 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1296 microversion: 2.1 time: 0.146904 Aug 30 04:21:17.870620 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 146/283] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:18.490552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.491169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.511018 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.511705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.512524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.513564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.514166 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.514752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.795281 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.805592 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.807663 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.809305 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5d3b0158-4cfb-41c8-ada1-6ac3df90db6c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.322719 Aug 30 04:21:18.810344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 138/284] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:18.896884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.897496 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.915200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.916159 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.918710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.920026 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.920501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.920922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.931055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:19.037354 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.052875 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-765d1a7d-f7b5-4af1-aaed-15a2bde76e4d tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1302 microversion: 2.1 time: 0.159405 Aug 30 04:21:19.054322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 147/285] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:19.835077 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.835683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.849228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.850002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.850002 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.857508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.861310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.861780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.082080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.084868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.095791 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.096756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.097703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.106242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.107853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.108572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.225349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.244181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.246193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.247724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-38430786-f88b-42f2-8c35-274c3b8d99d4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.416546 Aug 30 04:21:20.271456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 139/286] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:20.391464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.402924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c998469d-9dbf-4098-ae09-1d2f8c460ca2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.325270 Aug 30 04:21:20.404032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 148/287] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:20.786967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:20.812008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.815763 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.823538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.846202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] Creating event network-changed:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:21:20.861229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-9a7462c2-b318-4c90-aff1-ebd5616a6a85 req-2822ca62-7f76-42c3-b6c1-b94d7efff39d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078351 Aug 30 04:21:20.862442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 140/288] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:21.294265 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.302724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.305469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.306222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.306959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.308135 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.309088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.309740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.429520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.430727 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.471916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.472736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.473346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.474243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.474902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.475484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.663942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.672499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.687260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.688476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6a138806-d517-4ec8-8462-979da61e0554 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.400929 Aug 30 04:21:21.689033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 149/289] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:21.723174 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:21.734466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.735226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.735826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.809821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Going to try to stop instance {{(pid=120496) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:21:21.857496 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.867258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c3561865-fdc0-4fab-a912-710b1114b4b4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.442964 Aug 30 04:21:21.869012 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 141/290] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:21.885819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-088f13dc-0728-4cd3-b44a-004501c2d236 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action" status: 202 len: 0 microversion: 2.1 time: 0.166809 Aug 30 04:21:21.888963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 150/291] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:21 2022] POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:21.895778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.896463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.909687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.910460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.911073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.911972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.912412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.912995 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.063912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.073503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ea454d75-94fd-408d-a4d6-bf50298b3f6d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.181865 Aug 30 04:21:22.074072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 142/292] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:22.716537 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.717861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.724675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.725210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.728156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.729068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.729681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.730347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.891204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.891820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.906223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.906766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.907282 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.908641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.909325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.913321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.004600 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.017697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.019991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.021972 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c8bc3a39-9bed-47f9-84e3-f957dc1cf179 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.312495 Aug 30 04:21:23.024709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 151/293] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:23.031088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1944632875", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "networks": [{"uuid": "2774a858-2972-416a-bca6-0cf962f4b9d8"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:23.113913 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] validate_networks() for [('2774a858-2972-416a-bca6-0cf962f4b9d8', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:21:23.327187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.335621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7275afa-e35e-470b-8453-c345154f59fb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.448978 Aug 30 04:21:23.351729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 143/294] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:23.358054 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.359148 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.371277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.374211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.374888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.375852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.376502 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.377425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.604569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:23.604569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:23.605060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:23.605422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:23.606524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:23.623836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.624317 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.624746 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.625490 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.625895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.626340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.631502 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.647266 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6a2bad96-e822-4df6-83de-757d5a37c98c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.293497 Aug 30 04:21:23.648023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 144/295] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:23.653139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Getting quotas for project 7ca6dbede37a49528a555112bcfd816a. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:23.659106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Getting quotas for user e2f26641d43843eebbeb4eca40f306d2 and project 7ca6dbede37a49528a555112bcfd816a. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:23.675256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:23.677609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:23.744652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-05e5d5ef-236a-4b5e-b3a1-9e678580864d tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717631 Aug 30 04:21:23.746857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 152/296] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:23.759989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-47a2aaf5-c1d9-4484-a90b-0c6a64119556 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.760706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-47a2aaf5-c1d9-4484-a90b-0c6a64119556 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.835631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47a2aaf5-c1d9-4484-a90b-0c6a64119556 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.843358 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-47a2aaf5-c1d9-4484-a90b-0c6a64119556 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1214 microversion: 2.1 time: 0.089192 Aug 30 04:21:23.844489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 145/297] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:24.051182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.052086 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.060599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.061429 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.062117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.063083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.063604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.064102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.228307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.238731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.240720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.244298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4eea8952-9a82-498e-94dc-64097ad5198f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.194969 Aug 30 04:21:24.258432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 153/298] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:24.359195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.360436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.362650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:24.369299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.369788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.370221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.370960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.371420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.371838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.515402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.524001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-23a3a913-17dc-4fae-b409-01b577f9763f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.168432 Aug 30 04:21:24.524740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 146/299] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:24.669331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.670128 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.681480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.682306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.682914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.683788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.684383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.684958 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.884209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.895387 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5942501b-36aa-4b44-a9c2-d89e77ee425d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.229862 Aug 30 04:21:24.896292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 154/300] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:24.911349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.913034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.957261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.957920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.958697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.959960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.960647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.962216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.029031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.037320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ac1dd819-bb67-4efd-b0e8-1de943df3513 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1218 microversion: 2.1 time: 0.175539 Aug 30 04:21:25.037905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 147/301] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:25.276910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.277916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.284420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.285001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.285530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.286380 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.286897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.287388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.465004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.473174 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.474652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.475821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a3d33980-5bb5-4eff-9583-6ffee778dc28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.202854 Aug 30 04:21:25.476420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 155/302] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:25.545539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.546656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.558480 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.559249 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.559852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.560698 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.561296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.561866 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.681918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1df30bbd-a5b6-4762-83a8-51ba290a857d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'create', calling method: .version_select at 0x7faa0d86aca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-118234452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYfU+ehStAYfvKry/dpOY7bqVIs/7s+HT5inN9oEj7hHsIJWwV0wowTKJtVFY5WGseEEh7X0qlEO02E5Gwc3uFVKakMLq7/UOsrbml6korRnNgm3mfKM6D9MW9IS/UWnA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:25.697794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-1df30bbd-a5b6-4762-83a8-51ba290a857d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Getting quotas for project ddae968572774fa5b3d0a561b5c1b085. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:25.701687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-1df30bbd-a5b6-4762-83a8-51ba290a857d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Getting quotas for user cebdac97042f43ab9a900087d1ee6a3e and project ddae968572774fa5b3d0a561b5c1b085. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:25.715194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.723779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1ed0e146-57a7-4c7e-ac3c-26e3e06fe09f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.182296 Aug 30 04:21:25.724354 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 148/303] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:25.725733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1df30bbd-a5b6-4762-83a8-51ba290a857d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047667 Aug 30 04:21:25.726337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 156/304] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:21:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:25.828313 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-572027345", "imageRef": "930c383d-0433-43f0-842a-4ba4e623f8e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-118234452", "networks": [{"uuid": "dd2a8049-b917-49e6-b871-9134d7a6f650"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:25.879951 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] validate_networks() for [('dd2a8049-b917-49e6-b871-9134d7a6f650', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:21:25.928991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.929633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.935588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.936067 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.936498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.937188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.937633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.938079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.079869 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.088557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-33a4987c-4515-49e5-a3a4-f079bb08f370 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.163521 Aug 30 04:21:26.089130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 157/305] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:26.093529 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.094128 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.096033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:26.100683 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.101164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.102225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.102925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.103355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.103773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.169178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.176690 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a24577bb-0ee1-48a2-99db-6a9e78d93fc2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1218 microversion: 2.1 time: 0.086600 Aug 30 04:21:26.177259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 158/306] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:26.270961 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:26.271375 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:26.271839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:26.272233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:26.272631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:26.282390 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.282958 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.283385 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.284099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.284562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.284978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.301964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Getting quotas for project ddae968572774fa5b3d0a561b5c1b085. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:26.306003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Getting quotas for user cebdac97042f43ab9a900087d1ee6a3e and project ddae968572774fa5b3d0a561b5c1b085. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:26.316732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:26.319009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='930c383d-0433-43f0-842a-4ba4e623f8e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:26.380429 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f1c5f89e-494e-454c-8e7d-88d41494212f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555908 Aug 30 04:21:26.381072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 149/307] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:26.392418 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f7a2128e-dca2-4935-85f9-c6aef2d5e2fa tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.393251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f7a2128e-dca2-4935-85f9-c6aef2d5e2fa tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.468743 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f7a2128e-dca2-4935-85f9-c6aef2d5e2fa tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.477256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f7a2128e-dca2-4935-85f9-c6aef2d5e2fa tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1257 microversion: 2.1 time: 0.088454 Aug 30 04:21:26.477502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 159/308] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1257 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:26.499315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.502901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.510339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.511272 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.511755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.512517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.513036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.513448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.667638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.679161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.681441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.682938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a978924e-e797-4a2a-8945-9ee203f19105 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.187658 Aug 30 04:21:26.694625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 150/309] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:26.748188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.750654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.767221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.767733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.768178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.768902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.769414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.769778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.951953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.959954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8a0a23fe-4d71-48e9-a6f6-7ca2644700da tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.217751 Aug 30 04:21:26.960517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 160/310] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:27.110428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.111032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:27.117480 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.117955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.118821 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.119916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.120369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.121540 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.197304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.197916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:27.207870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.208352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.208777 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.209500 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.209944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.210391 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.278956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.294152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e2f90296-bbb7-4c46-8421-ec717040cbc8 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1266 microversion: 2.1 time: 0.100529 Aug 30 04:21:27.302545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 161/311] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:27.504299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.504924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:27.521352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.524435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.525766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.526730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.527192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.527800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.625806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.630976 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.636386 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-794e3206-03f4-483e-a138-d949311ee8c6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1309 microversion: 2.1 time: 0.142392 Aug 30 04:21:27.637544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 162/312] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1309 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:27.643107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-789de20f-c79e-4114-af87-77dff280e061 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.536556 Aug 30 04:21:27.644314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 151/313] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:27.712890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.714106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:27.727436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.728239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.729388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.730852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.731575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.732331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.891633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.900624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.902095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:27.903479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7156843b-0e3d-4320-b146-78768d7e576b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.199599 Aug 30 04:21:27.904038 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 163/314] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:27.981173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.981793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:27.987664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.988139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.988567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.989246 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.989686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.990096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.291434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:28.299556 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1bdc5cee-ffe8-47ab-b198-7cb986cc78de tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.322245 Aug 30 04:21:28.315640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 152/315] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:28.319804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.320861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:28.328180 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.329005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.329554 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.330587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.331301 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.331838 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.402046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:28.411619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-befba754-22b6-4a06-bf43-b3b33f822010 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1272 microversion: 2.1 time: 0.097760 Aug 30 04:21:28.412420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 164/316] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:28.559460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "name": "network-vif-plugged", "status": "completed", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:28.571690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.572412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.574190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.590669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] Creating event network-vif-plugged:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:21:28.599027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-a2846749-7c28-4059-af7c-9893acb07a67 req-bf2d2ffa-48de-42e5-8e7e-fe3d6daf1bc0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042324 Aug 30 04:21:28.606633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 153/317] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:28.662407 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.663562 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:28.671759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.672606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.673588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.674655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.675477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.676118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.677620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.678692 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:28.691145 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.692151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.692775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.693753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.694389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.696253 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.701704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:28.729234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:28.776814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:28.802939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-00acf80a-9ac4-4455-b6f8-6623a96647ef tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1315 microversion: 2.1 time: 0.146255 Aug 30 04:21:28.803576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 165/318] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:28.930560 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.932163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:28.946831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.949526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.950485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:28.952047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:28.952569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:28.953439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.179165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.203356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eeec958f-0ce2-438e-9c89-3a4760b5ac7f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.535215 Aug 30 04:21:29.204237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 154/319] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:29.204640 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.225163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.227778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.229304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-50da20af-28ba-47f3-880b-a209dac3f74a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.307208 Aug 30 04:21:29.231645 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 166/320] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:29.323164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:29.324056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:29.335539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.336335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.336954 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.337818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.338446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.339838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.437056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:29.438048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:29.450035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.452987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.453458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.455906 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.456678 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.458349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.675741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.690300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4a2231d2-b703-4398-9014-73c5edc4c60f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.257579 Aug 30 04:21:29.699583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 167/321] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:29 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:29.769361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:29.778718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0a4e7fca-3c4d-4f1a-b5cc-fb9720420c72 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.460389 Aug 30 04:21:29.786901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 155/322] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:29 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:29.829350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:29.831289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:29.854531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.857226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.857775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:29.858928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:29.859630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:29.860291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.104504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.116120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4307af5-7bf4-4088-8292-2ccf4c2c22ac tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.292561 Aug 30 04:21:30.117846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 168/323] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:29 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:30.192280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53690b9c-2325-4266-9b6b-3ba3b9a2bed5", "tag": "f9d6de7b-f967-4a19-b72e-49fb8dbc3981"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:30.212196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.216085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.218397 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.225415 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.226430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.242440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.244482 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.247663 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.248437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.248904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.249332 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.262572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] Creating event network-changed:f9d6de7b-f967-4a19-b72e-49fb8dbc3981 for instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 on hv-cinder-85220 Aug 30 04:21:30.277093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-aed0c401-ca0e-4a89-98fd-38037dd05dbf req-8f54c205-d9ae-4cf6-8a84-9e98cc4953c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089621 Aug 30 04:21:30.278037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 156/324] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:30.287734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.288701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.296799 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.297610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.298233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.299139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.300158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.300946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.448125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.459262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7170c481-b342-4ba4-990c-c666fc23db1c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.237979 Aug 30 04:21:30.474877 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 169/325] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:30.509611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.518083 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.519747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.520967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edfff13f-8941-4e82-b1a7-23839f035396 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.241743 Aug 30 04:21:30.521543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 157/326] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:30.720894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.721537 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.729111 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.729569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.730066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.731117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.731261 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.731680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.803830 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.804963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:30.812071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.812920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.813528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.814669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:30.815326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:30.815944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:30.919146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:30.930110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c25452a2-b173-4ded-9dbe-5a2aa6aeaddb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.212215 Aug 30 04:21:30.946906 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 170/327] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:31.006154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.015330 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fa5a5255-cdad-4dfc-99dd-2c3e23e89dea tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.215783 Aug 30 04:21:31.015964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 158/328] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:31.139835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.140615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:31.147156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.147772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.148976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.150080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.150723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.150950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.314408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.323966 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30f8be32-1ffd-4583-a409-216496d5df99 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.187828 Aug 30 04:21:31.324818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 171/329] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:31.483490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.484756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:31.487517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:31.494909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.495436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.495906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.496820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.497277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.497775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.546232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.547532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:31.554202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.555054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.555498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.556213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.556667 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.557090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.683952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.692699 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c1d8e3a-bb77-45c2-ae60-62ad0582a5bb tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.213194 Aug 30 04:21:31.706765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 159/330] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:31.768541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.778616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.780134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.781304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-28f3c27d-bbc1-4c74-a9f8-28f0cff5ecdd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.239887 Aug 30 04:21:31.781860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 172/331] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:31.953055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.953868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:31.960051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.960966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.961766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.962607 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.963277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.963971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.036456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.037057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.046916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.046916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.046916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.047224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.047535 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.048144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.110474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:32.120783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-270ef3b3-1e62-474e-914d-d6fd4b121866 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.171567 Aug 30 04:21:32.121506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 160/332] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.216421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:32.224497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-125d41bc-77cc-464b-a6f7-7eaad2eac5f2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.191836 Aug 30 04:21:32.225238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 173/333] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:32.347168 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.347928 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.356160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.356656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.357147 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.357843 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.358323 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.358736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.565833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:32.577108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-264f7f90-9bfc-482b-ae71-167418972131 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.233644 Aug 30 04:21:32.577904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 161/334] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.723997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.725275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.746388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.747784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.748541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.749460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.750092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.750720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.807669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.808560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.829586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.830129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.830594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.834048 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.834550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.834985 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.995275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.015613 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8cece997-e7f8-4d52-91e6-f6ec95b8b8c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.296424 Aug 30 04:21:33.017311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 174/335] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.060001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.073773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.080121 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.082384 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f680ff2e-348b-4d42-a2fb-90a1740cc1b2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.279649 Aug 30 04:21:33.095399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 162/336] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:33.145248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.147114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.157466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.158445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.159189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.160239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.161228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.162018 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.255905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.263262 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.285445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.289540 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.290590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.293099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.294522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.294522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.410916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.421072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7dbc43a0-137b-4d69-ad58-4f9b352fa58e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.279866 Aug 30 04:21:33.421695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 175/337] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.539732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.549749 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4c994c49-8ea7-464d-882b-a8d73178b475 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.305916 Aug 30 04:21:33.558392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 163/338] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.604201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.605553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.612276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.613401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.613897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.615385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.615747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.618420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.638437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:33.775388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.785591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7a0eb81f-c179-4b88-bbb5-a56ed009254e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.185925 Aug 30 04:21:33.786462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 176/339] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:34.051016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.051704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.059223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.059781 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.060222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.060920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.061403 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.061884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.115546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.116158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.124198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.124684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.125118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.125816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.126292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.126705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.302732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.317115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5e84d9d1-94dc-4444-962d-aa7f7e7fe467 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.272639 Aug 30 04:21:34.337603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 164/340] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:34.421918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.435501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.439340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.448437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c3b27f72-572d-4288-8e50-746a20bd2b2c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.336784 Aug 30 04:21:34.449354 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 177/341] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:34.459052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.459753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.475108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.475657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.476199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.477176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.477634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.483893 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.582083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.583162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.590570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.596603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.597297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.598201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.598837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.599439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.766779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.777552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c8139d6a-3b8e-4f33-92e0-c87ef990e7c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.336148 Aug 30 04:21:34.791484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 165/342] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:34.817184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.820824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.828230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.828723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.829162 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.829867 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.830353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.830764 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.890585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.900827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2cfc6296-5fb2-44b6-ac03-99ff7aa80d1c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.326422 Aug 30 04:21:34.916652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 178/343] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:34.999286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.016111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe2e9650-0666-4cbf-9e32-059df877d1d2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.213225 Aug 30 04:21:35.017409 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 166/344] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:35.343742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.344352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.350697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.351165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.352353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.352961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.353399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.353812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.480296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.482387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.492996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.504894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.505957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.511767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.512567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.513194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.531585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.541960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4ca93144-3172-467c-a55c-b6e3f9b199ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.201769 Aug 30 04:21:35.542843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 179/345] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:35.693842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.703273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.704835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.706118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0e4ba76a-fb9e-4deb-91f4-d49099037620 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.233851 Aug 30 04:21:35.711974 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 167/346] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:35.798091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.799027 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.806388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.807165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.807757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.808629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.809241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.809979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.930859 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.931738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.939029 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.939679 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.940382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.941198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:35.941871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:35.942547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.957540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.967970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-44235b90-4c8a-451c-8843-3f3c37773ae2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.173576 Aug 30 04:21:35.968967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 180/347] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:36.037718 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.038605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.045824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.046473 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.047001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.047797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.048348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.048890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.088510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.097361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a7f644d7-7327-4493-bf30-2bb9ba176e08 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.171762 Aug 30 04:21:36.110285 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 168/348] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:36.190102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.198875 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4853e030-adb5-48b2-a467-7b3971a291b8 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.165191 Aug 30 04:21:36.199468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 181/349] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:36.563732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.564483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.566663 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.567480 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=14 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.574721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.575209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.575646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.576351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.576803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.577219 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.732093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.733010 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.733416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.736272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=18 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.742713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.743204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.743612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7051c3a9-12c8-455b-b0e6-5d9328f1ab2b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.183535 Aug 30 04:21:36.743741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.746299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.746477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 169/350] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:36.746596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.746596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.750445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.923392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.933665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.935369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.936563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-558368f9-18b0-4ca9-8b91-47c16a2e8482 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.210288 Aug 30 04:21:36.937678 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 182/351] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:36.990495 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.991312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.998761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.999360 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.999890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.000686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.001240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.001756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.119541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.120148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.126495 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.126977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.127408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.128099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.128545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.128967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.173159 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.185327 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e3403c5f-52b7-4741-84ab-7c13f629577f tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.199780 Aug 30 04:21:37.185949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 170/352] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:37.221342 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.222646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.233403 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.233899 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.234363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.235076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.235531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.235957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.283550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.297319 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b38ba172-2611-44f2-a0ae-b5f2de71d44b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.179985 Aug 30 04:21:37.298651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 183/353] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:37.405210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.408713 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:37.414507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f493fcc6-c34b-439b-915c-5a2d0596edb1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.196462 Aug 30 04:21:37.415299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 171/354] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:37.765372 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.765969 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.772630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.773665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.774205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.775289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.775436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.775755 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.914607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.922855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-79ce0420-ac68-4798-bbe8-b76577fe29c7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.161395 Aug 30 04:21:37.923431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 184/355] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:37.961127 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.961809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.968320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.968725 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.969154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.969833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.970306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.970726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.101941 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.110064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.111536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.113312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ca57474d-3f2e-477e-ad89-7ad9b7ba311d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.156382 Aug 30 04:21:38.113888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 172/356] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:38.207355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.207988 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.215204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.215689 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.216125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.216814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.217268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.217691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.322421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.323134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.329019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.329494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.329924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.330644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.331093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.331512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.347822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.356223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d76634d8-448b-4bae-acaa-3b1fe626b122 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.152715 Aug 30 04:21:38.356798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 185/357] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:38.436016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.436615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.442425 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.442902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.443321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.443998 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.444438 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.444846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.462069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.469746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2151245b-1ac9-43de-b78d-f6d618956cba tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.151297 Aug 30 04:21:38.470366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 173/358] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:38.584865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.592834 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bc55b035-25a5-46a9-a1d0-84531a67af3f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.160774 Aug 30 04:21:38.593399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 186/359] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:38.943446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.944086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.950218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.950716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.951141 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.951818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.952260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.952672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.082281 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.090591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9f41a61e-5d0a-46b2-88b3-3a1ba05b611f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.150944 Aug 30 04:21:39.091158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 174/360] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:39.137247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.137768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.144703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.145175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.145601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.146309 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.146759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.147169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.279358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.287358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.288832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.290394 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9ae25889-f260-42a5-b341-7944826219e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.157651 Aug 30 04:21:39.290953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 187/361] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:39.377411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.378014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.384588 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.385059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.385486 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.386161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.386637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.387053 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.491198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.492633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.498789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.499272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.499703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.500392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.500841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.501259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.517277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.528270 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fe0f2a8d-06f8-4628-b4ac-7e61c4c78ebb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.154595 Aug 30 04:21:39.528868 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 175/362] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:39.614182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.615048 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.622286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.622903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.623405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.624160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.624677 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.625158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.646394 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.654753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d2a7f306-d261-442f-a31f-8704613ca7c2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.167336 Aug 30 04:21:39.655320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 188/363] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:39.754640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.762370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4ce993b3-c222-420b-ad94-d014cb35ace0 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.152064 Aug 30 04:21:39.762937 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 176/364] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:40.111719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.112352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.119511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.119982 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.120408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.121087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.121531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.121944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.261553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.270077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9a99474c-9edd-43fc-aa18-aaa92d5baed2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1723 microversion: 2.1 time: 0.162214 Aug 30 04:21:40.270674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 189/365] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:40.313003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.313593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.320448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.321019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.321447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.322134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.322610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.323029 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.474312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.482810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.484252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.485431 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ebfdaf61-8afc-4811-831b-5e8e348cc4dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.176352 Aug 30 04:21:40.485983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 177/366] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:40.550604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.551235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.557823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.558322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.558760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.559445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.559891 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.560310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.675756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.676368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.683604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.684188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.684896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.685684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.686209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.686843 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.689718 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.697491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-92aaea22-3063-4b94-9c7b-844bc078a5b9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.150788 Aug 30 04:21:40.698072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 190/367] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:40.797804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.798455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.811387 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.811885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.814792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.815721 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.816331 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.816925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.863387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.874689 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a07f9806-19b1-44e8-acd0-2ef5e40b8b91 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.202770 Aug 30 04:21:40.875378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 178/368] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:40.982537 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:40.990763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ce67ce15-9844-4796-81db-a5222a2bb27d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.203055 Aug 30 04:21:40.991417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 191/369] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:41.292942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.293616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.304989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.305770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.306352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.307061 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.307512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.308126 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.509296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.509905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.517464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.517953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.518408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.519528 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.520136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.520990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.678632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.687692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.689211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.690445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5fefe17f-9508-4a1e-8e8f-a4ba5244e1f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.185747 Aug 30 04:21:41.691015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 192/370] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:41.718627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.719398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.725452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.725931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.726505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.727386 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.727845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.728302 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.849084 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.860318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5794dce7-88c8-4816-abd9-6584e8c7e6ca tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1700 microversion: 2.1 time: 0.572319 Aug 30 04:21:41.861148 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 179/371] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1700 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:41.884247 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:41.892585 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.893074 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.893503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.965807 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Going to try to start instance {{(pid=120495) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:21:42.019001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79903548-22e1-47f6-8e6c-35b09ef7ae96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action" status: 202 len: 0 microversion: 2.1 time: 0.139003 Aug 30 04:21:42.020252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 180/372] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:41 2022] POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:21:42.026746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.027446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.033896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.034407 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.035048 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.035737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.036182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.036775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.067007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.075733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c07c8ab1-2491-4018-9a9b-47d40f03f6f2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.361129 Aug 30 04:21:42.076312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 193/373] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:42.080972 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:42.091203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.091674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.092109 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.103313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] Creating event network-changed:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:21:42.108234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-463410f6-a4ac-408a-bc92-4bb67adb9934 req-37c311a1-0f2f-4e81-8379-8e3d22b0f0eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030616 Aug 30 04:21:42.108849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 194/374] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:42.113924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.114764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.121826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.122280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.122723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.123419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.123868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.124290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.173553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.181109 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-74853b14-d447-4c65-9187-6286468ced9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1369 microversion: 2.1 time: 0.159367 Aug 30 04:21:42.181680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 181/375] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.187858 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.188049 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.193804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.194346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.194776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.195479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.196117 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.196385 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.267369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.275578 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-01ac4fad-b51f-4f1d-b23e-42dc15f5b14d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.165507 Aug 30 04:21:42.276259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 195/376] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.340033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.348908 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79ab84bc-3e8a-4e5c-b4b2-8c4dcb8e0b5c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1709 microversion: 2.1 time: 0.166173 Aug 30 04:21:42.349570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 182/377] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.715524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.717229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.725193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.725833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.726615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.727630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.728167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.728794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.906808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.916867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.918400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.919600 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4a1e8c44-0e1f-437d-86fe-358f40b9d090 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1745 microversion: 2.20 time: 0.209367 Aug 30 04:21:42.920381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 196/378] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1745 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:43.096926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.097532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.105118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.105599 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.106028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.106748 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.107200 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.107618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.201746 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.202377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.209078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.209632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.210071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.210987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.211787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.212218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.347460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.355523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e513951-565b-410d-bb54-b2cd89e68b16 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1563 microversion: 2.1 time: 0.157608 Aug 30 04:21:43.356294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 197/379] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:43.377419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.378031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.384832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.385318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.385746 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.386470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.386914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.387337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.466094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.474085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-18fc7e9d-b8d3-4041-a537-69bf9f83b797 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.381230 Aug 30 04:21:43.478283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 183/380] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:43.479813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.480608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.486514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.486989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.487422 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.488108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.488551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.488967 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.530593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.538152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-632df933-7d4c-43aa-9a7f-e1bbe186b9fb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.169905 Aug 30 04:21:43.546228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 198/381] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:43.546228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.546228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.551295 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.551774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.552211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.553048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.553629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.554053 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.569175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:43.638152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6d8efce2-4ebd-44f6-9596-7d4432b43d11 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098043 Aug 30 04:21:43.638801 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 199/382] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:43.638925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.647320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1a4a4b68-e655-454b-bab3-37902f6db4a6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1709 microversion: 2.1 time: 0.171396 Aug 30 04:21:43.648656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 184/383] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1709 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:43.944268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.945446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.951720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.952203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.952633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.953337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.953789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.954213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.084447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.093785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.095308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.096473 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-948eda1f-beb1-4b56-8584-e181ccf5deac tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1745 microversion: 2.20 time: 0.156661 Aug 30 04:21:44.097033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 200/384] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:44.495586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.496812 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.503998 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.504683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.505311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.506163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.506795 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.507377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.561229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.562619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.573745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.574338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.574785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.576225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.576695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.577110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.768924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.778438 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a83bb9ec-141b-44db-875c-da66109e1991 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.222426 Aug 30 04:21:44.786304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 201/385] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:44.786304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.786304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.793363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.794013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.794586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.795407 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.795977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.796513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.933538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.941780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-78809ebc-f6f7-440d-b2ab-9118866fcd91 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1709 microversion: 2.1 time: 0.161129 Aug 30 04:21:44.942377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 202/386] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:44.954357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "name": "network-vif-plugged", "status": "completed", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:44.964501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.964980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.965404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.977505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] Creating event network-vif-plugged:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:21:44.982573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-2a7ecc14-6413-4da4-b714-ac253ac9076c req-3ff20941-4085-47e1-aee4-091ed0302b2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038989 Aug 30 04:21:44.983175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 203/387] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:45.124853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.125544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.131669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.132140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.132569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.133306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.133804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.134218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.177257 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.185892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8558286-80e5-470b-b884-809db417e9df tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.695106 Aug 30 04:21:45.194106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 185/388] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:45.272995 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.281133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.282588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.283746 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-652f7316-9444-4eb8-8d27-131fa815e475 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1745 microversion: 2.20 time: 0.163454 Aug 30 04:21:45.284298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 204/389] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:45.453226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:45.464275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.464744 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.465164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.476360 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] Creating event network-changed:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:21:45.481499 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-823be3a2-50f2-4707-9093-cae696f6f4fd req-24efa2af-4960-4a77-8185-300996b00e0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032372 Aug 30 04:21:45.482083 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 186/390] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:45.805297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.806068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.812655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.813240 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.813811 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.814629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.815176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.815771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.948583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.956238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b598c98f-9ad4-41d2-b0e4-0b68bea9e181 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.155236 Aug 30 04:21:45.957484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 205/391] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:45.964137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.964828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.971278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.971779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.972231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.972922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.973361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.973919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.112687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.121295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bd5ce3b5-26c9-490d-ad07-184c12397a40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1709 microversion: 2.1 time: 0.161932 Aug 30 04:21:46.121866 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 187/392] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.209044 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.209993 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:46.216418 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.216899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.217336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.218030 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.218565 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.218981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.308424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.309235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:46.317740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.321439 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.322460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.323379 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.323833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.324485 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.331427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.372554 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.392677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-443c8768-9a5e-4f48-b39e-f383390562fe tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.187239 Aug 30 04:21:46.393505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 206/393] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.497869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.506355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.507929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.509328 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dd146cce-61b0-405f-b3d5-c4a505c753ef tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.205314 Aug 30 04:21:46.522455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 188/394] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:46.978888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.979646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:46.982351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:46.987943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.988559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.989108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.989913 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.990517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.991149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.131544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.141062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fa784ec2-87d2-428b-b4a6-aabd4c3d1e3e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.166800 Aug 30 04:21:47.141633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 207/395] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:47.143536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.144149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.152178 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.152766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.153207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.153938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.154436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.154882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.371792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.380536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85e13bb8-ed47-42b8-bc52-59ae3e5c394f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1713 microversion: 2.1 time: 0.241138 Aug 30 04:21:47.381102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 189/396] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1713 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:47.418116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.419670 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.427037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.428311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.429115 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.430852 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.432101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.433642 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.533416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.534024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.541217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.542000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.542687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.544051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.545197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.545852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.592114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.600830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bb5e080c-d99d-4a62-947a-9029d7f223ec tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.188306 Aug 30 04:21:47.602147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 208/397] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:47.819566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.844500 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.846969 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.849044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b612bd0b-8a91-4431-bdbf-13ac5de8f313 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.319549 Aug 30 04:21:47.864796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 190/398] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:48.165022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.166868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:48.174068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.174920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.175531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.176384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.177184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.177827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.334182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.344536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4acb511e-ea07-4ea8-a537-452bdcce3d07 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.184861 Aug 30 04:21:48.345139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 209/399] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.623355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.624804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:48.635503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.643389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.644684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.646041 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.647116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.647774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.853362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.866212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa07f12f-9613-4273-9d72-16ce2a62213a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.244588 Aug 30 04:21:48.878705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.878944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 191/400] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.879040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:48.887368 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.887943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.888500 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.889408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.889929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.891080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.065920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.082233 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.083971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.085480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-482376c8-e297-4ec6-a10c-856d032b4f66 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.211641 Aug 30 04:21:49.090839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 210/401] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:49.135210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53690b9c-2325-4266-9b6b-3ba3b9a2bed5", "name": "network-vif-plugged", "status": "completed", "tag": "f9d6de7b-f967-4a19-b72e-49fb8dbc3981"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:49.151573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.152504 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.153103 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.170763 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] Creating event network-vif-plugged:f9d6de7b-f967-4a19-b72e-49fb8dbc3981 for instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 on hv-cinder-85220 Aug 30 04:21:49.177397 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-14cdb188-fc5c-436a-9ba5-9788cd706bcc req-352e7969-e089-4aa0-b6f7-5526b2513e8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046094 Aug 30 04:21:49.178844 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 192/402] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:49.368475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.370388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:49.392759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.393620 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.394342 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.398660 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.401639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.402084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.578155 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.588032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e6cb3087-067a-4bc4-a8d9-e165cebc8b2b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.224773 Aug 30 04:21:49.590286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 211/403] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:49.889931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.891312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:49.898529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.899398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.899855 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.900557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.901003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.901420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.058100 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.065964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83e31c39-7d57-4d91-a013-fb05a0275ba2 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.180703 Aug 30 04:21:50.082602 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 193/404] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:50.114673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.115281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.122728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.123218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.123647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.124360 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.124812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.125239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.279165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.287955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.289491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.290724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0594ea01-2b5f-4c94-b213-b10aaa07a93b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.179981 Aug 30 04:21:50.291504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 212/405] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:50.612014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.612987 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.620383 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.620869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.621301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.622004 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.622535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.623158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.835273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.844134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-63608776-db3f-49fc-ab09-d0bdc12099a6 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.236094 Aug 30 04:21:50.845039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 194/406] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:51.090725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.092119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.099553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.100365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.101001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.102847 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.103480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.104065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.224133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "name": "network-vif-plugged", "status": "completed", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:51.248276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.249695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.250446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.266140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] Creating event network-vif-plugged:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:21:51.272173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-3077673e-2877-46ce-b2c1-651703a9dd19 req-74b7cccc-a426-424a-b572-cba9e513202e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059637 Aug 30 04:21:51.273235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 195/407] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:51.295777 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.306419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b053007b-3bfd-4b63-9d9a-510506e49d61 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1314 microversion: 2.1 time: 0.220990 Aug 30 04:21:51.307277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 213/408] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:51.319238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.321769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.334107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.334896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.336181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.336799 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.337474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.338052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.537979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.553451 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.555916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.557103 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-26d64a46-43bc-47cd-bc4d-1e2e1626ce0b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.242741 Aug 30 04:21:51.557670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 196/409] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:51.867845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.869927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.876329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.876811 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.877241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.878083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.878562 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.878986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.034517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.048937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-68c98a63-268b-4199-a560-a04b3d375a37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.185127 Aug 30 04:21:52.049521 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 214/410] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:52.328107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:52.329427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:52.336953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.337871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.338494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.339599 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.340209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.340790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.512084 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.521872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e6dde85b-a9fb-4d26-8f61-af075c0d029a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1499 microversion: 2.1 time: 0.197881 Aug 30 04:21:52.523760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 197/411] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:52 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1499 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:52.586594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:52.588547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:52.596480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.597199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.597645 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.598541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.599278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.599931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.748404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.758546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.760719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.762483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7b963942-65ce-4c61-b949-48a846719002 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.182470 Aug 30 04:21:52.763205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 215/412] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:52 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:53.073319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.074107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.081874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.082528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.082988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.083786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.084348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.084860 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.092477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.093060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.102106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.105413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.105413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.106804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.107279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.107890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.145182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:53.163262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:53.248470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1d9f4d2e-b8b5-48b8-8695-5737297ca520 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "DELETE /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 204 len: 0 microversion: 2.1 time: 0.160555 Aug 30 04:21:53.249448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 216/413] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:21:53 2022] DELETE /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:21:53.261817 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.264261 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.265201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.270228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5f43d1ab-e1cd-4dac-9118-1dce8052424d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1357 microversion: 2.1 time: 0.201723 Aug 30 04:21:53.271199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 198/414] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:53.272394 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.273175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.273946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.274984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.275632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.276263 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.424146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.433642 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4ed2f557-274f-472c-aa5d-d9c56b78e39a tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1505 microversion: 2.1 time: 0.179530 Aug 30 04:21:53.434725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 217/415] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:53.787908 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.788767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.795030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.795720 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.796387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.797296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.797956 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.798626 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.963504 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.971950 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.973396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.974581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14a6d4ad-ee29-4d6b-bce5-643aa7042504 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.191172 Aug 30 04:21:53.975454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 199/416] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:54.298550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.299168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:54.309056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.310099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.311437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.314617 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.316196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.317172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.458564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.459298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:54.467242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.467843 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.468386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.469298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.469826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.471042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.531283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.541162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9428ee31-d159-4982-abd9-7d1b9008fad5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1547 microversion: 2.1 time: 0.252163 Aug 30 04:21:54.542680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 218/417] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1547 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:54.564784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.565304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:54.572395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.572879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.573457 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.574697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.575336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.575767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.717942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.730979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-52cca423-abf3-42d1-81bc-b2c4feba3a45 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1505 microversion: 2.1 time: 0.276337 Aug 30 04:21:54.732181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 200/418] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:54.769307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.785451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-24bf49ea-1628-4d44-aef5-c2e8d2b45f3d tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1547 microversion: 2.1 time: 0.224155 Aug 30 04:21:54.786515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 219/419] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:54.830820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.839541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.840317 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Searching by: {'deleted': False, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085'} {{(pid=120495) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:21:54.856656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.857965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.859242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.861358 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.862970 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.863561 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.997167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.997951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.012729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.013344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.013849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.015059 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.015232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.015655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.051760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.multi_cell_list [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120495) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:21:55.196684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.202179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d5ac7f84-1aef-469d-a3f2-7b2c453be137 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.398382 Aug 30 04:21:55.203268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 201/420] 10.222.0.46 () {58 vars in 1125 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:55.213184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.214674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.215872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-df267f0f-c3be-4878-a025-3177c41b1258 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.222660 Aug 30 04:21:55.217942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 220/421] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:55.220628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:55.221439 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.228320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.229026 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.229622 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.230999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.231705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.232268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.450813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.463195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e8cbb8f4-80b1-4c49-bc5a-f45193a60873 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1547 microversion: 2.1 time: 0.249624 Aug 30 04:21:55.478958 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 202/422] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:55 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1547 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:55.755953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:55.756515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.768558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.769056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.769493 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.774550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.775411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.776659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.956750 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.967884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bbac4731-7380-478d-bd49-6d751afee838 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1505 microversion: 2.1 time: 0.216739 Aug 30 04:21:55.969044 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 221/423] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:55 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:56.147982 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53690b9c-2325-4266-9b6b-3ba3b9a2bed5", "name": "network-vif-deleted", "tag": "f9d6de7b-f967-4a19-b72e-49fb8dbc3981"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:56.174595 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.175828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:56.176711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:56.192338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] Creating event network-vif-deleted:f9d6de7b-f967-4a19-b72e-49fb8dbc3981 for instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 on hv-cinder-85220 Aug 30 04:21:56.198745 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-f2eb0900-0b7f-45b4-a0c1-aef01e25fc20 req-aa692d86-49b3-4862-9544-31e3ae43a999 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055311 Aug 30 04:21:56.199539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 203/424] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:56.242505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:56.244664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:56.254011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.254982 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:56.255942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:56.256924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.258536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:56.259447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:56.460224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.472268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.480459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.484169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-89317aa1-0211-400f-b802-4c29a54eae4c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.247524 Aug 30 04:21:56.485463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 222/425] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:56 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:56.992049 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:56.993135 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:56.999455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.999947 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.000382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.001071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.001525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.001947 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.051035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.051035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.051035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.051035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lazy-loading 'fault' on Instance uuid 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:21:57.094850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:57.106140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-64a06e10-be08-451e-b38a-cdcd8331e843 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 200 len: 1304 microversion: 2.1 time: 0.118877 Aug 30 04:21:57.107008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 204/426] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:56 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:57.418471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c9d0c8-9780-4fa2-8258-bd432015b8b8"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:57.421165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:57.428416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.429017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.429924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.430932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.432075 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.432581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.521466 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:57.522066 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:57.535587 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.536426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.536963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.537862 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.539498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.540143 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.739254 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:57.750710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:57.752576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:57.754184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c0c3c2d-d64c-47d3-8975-5902308a9d03 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1740 microversion: 2.20 time: 0.236905 Aug 30 04:21:57.754991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 205/427] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:57 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:57.781153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c556e8f7-8f33-4519-96c1-772d51d37807 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366440 Aug 30 04:21:57.782197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 223/428] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:21:57 2022] POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:58.128767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:58.129386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 53690b9c-2325-4266-9b6b-3ba3b9a2bed5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:58.136069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.136550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.137037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.137726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.138173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.138623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.143094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:58.152915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] HTTP exception thrown: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Request method failure captured: Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 HTTP/1.1 Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZBApck8qxiBpNRAEDMG-DSbHOE65GwMfeZYcJQjnbtEn5zTayCHtUYfCJSmZc3S3DeqpolwJtyUFTAg9ny4drm_5zmU9l6RqdqNBZ7rdTeThUg3qhd7CLWS59kZWsbakG9sJMM9spcdtLaO8JTWTFtlaY6vCjjVzkEF_04mPhqzDLI Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 7ca6dbede37a49528a555112bcfd816a Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesActionsTest-388239853 Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:21:58.154543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesActionsTest-388239853 Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 7ca6dbede37a49528a555112bcfd816a Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesActionsTest-388239853 Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesActionsTest-388239853-project Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: e2f26641d43843eebbeb4eca40f306d2 Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesActionsTest-388239853-project Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. Aug 30 04:21:58.156986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '53690b9c-2325-4266-9b6b-3ba3b9a2bed5'} Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:58.158755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. Aug 30 04:21:58.161453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:21:58.164437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Returning 404 to user: Instance 53690b9c-2325-4266-9b6b-3ba3b9a2bed5 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:58.164437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c750c5bc-9839-49f6-8397-dd6c6a37a458 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5" status: 404 len: 111 microversion: 2.1 time: 0.031059 Aug 30 04:21:58.164437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 206/429] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:58 2022] GET /compute/v2.1/servers/53690b9c-2325-4266-9b6b-3ba3b9a2bed5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:58.262334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-931759648", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "networks": [{"uuid": "2774a858-2972-416a-bca6-0cf962f4b9d8"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:58.317498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] validate_networks() for [('2774a858-2972-416a-bca6-0cf962f4b9d8', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:21:58.676832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:58.677446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:58.677724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:58.678159 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:58.678596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:58.688070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.688547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.688977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.689698 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.690148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.690598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.707730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Getting quotas for project 7ca6dbede37a49528a555112bcfd816a. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:58.712412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Getting quotas for user e2f26641d43843eebbeb4eca40f306d2 and project 7ca6dbede37a49528a555112bcfd816a. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:58.723979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:58.727284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:58.777218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30598d28-9def-44b1-afea-dc03521c14e3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520013 Aug 30 04:21:58.778141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 224/430] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:58.780773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:58.781563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:58.789374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.790204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.790938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.791889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.792436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8c2006f8-9af4-4dbe-93e3-9f7f7364d447 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:58.792800 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.793056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8c2006f8-9af4-4dbe-93e3-9f7f7364d447 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:58.793712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.859750 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8c2006f8-9af4-4dbe-93e3-9f7f7364d447 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:58.869238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8c2006f8-9af4-4dbe-93e3-9f7f7364d447 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1213 microversion: 2.1 time: 0.081795 Aug 30 04:21:58.869819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 225/431] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:58 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:59.048430 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:59.057529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:59.059040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:59.060199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3e28a2b5-31e3-4d7a-8ed8-cb12843b21a9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1722 microversion: 2.20 time: 0.284382 Aug 30 04:21:59.060762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 207/432] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:58 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:59.890878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:59.891486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:59.899367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.899898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.900329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:59.901015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.901461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.901879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:59.965850 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:59.973574 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-49575da0-fed4-454c-a21c-48680d8176a9 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1217 microversion: 2.1 time: 0.086643 Aug 30 04:21:59.980329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 226/433] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:59 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:00.083476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:00.084075 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:00.087156 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:00.092678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:00.093151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:00.093575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:00.094271 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:00.094721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:00.095145 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:00.222176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.230955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.232388 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.233551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eddb3289-753f-4974-adcf-9c95415b1119 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1722 microversion: 2.20 time: 0.153992 Aug 30 04:22:00.234104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 208/434] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:00 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:00.995640 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:00.996566 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:01.003038 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.003513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.003939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.004619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.005152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.005484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.077030 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.084912 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-47e68073-9c6b-46fb-a45f-60f757a39afa tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1209 microversion: 2.1 time: 0.093624 Aug 30 04:22:01.087675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 227/435] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:00 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:01.258514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:01.260059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:01.266820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.267979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.268594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.269467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.270068 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.270719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.490487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.502637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.504108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.505259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a6154784-4010-4691-b4ba-c687fc9ee85e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1725 microversion: 2.20 time: 0.252659 Aug 30 04:22:01.506190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 209/436] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:01 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:01.528361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d35711-a2df-4954-9cae-d709f360e434"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:01.530806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:01.537236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.537974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.538802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.539672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.540277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.540851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.892735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-818c48d0-6401-48b7-a9af-4a9acb108ee9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.367998 Aug 30 04:22:01.893377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 228/437] 10.222.0.46 () {62 vars in 1364 bytes} [Tue Aug 30 04:22:01 2022] POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments => generated 188 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:02.021345 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:02.021940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:02.028032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.028507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.028938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.029620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.030065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.030512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.073212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120495) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:22:02.109996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:02.110653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:02.130452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.130452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.130452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.130452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.130810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.130810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.156001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-35af0f48-a918-4a98-a4a9-0a83d8055d10 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/action" status: 202 len: 0 microversion: 2.20 time: 0.138865 Aug 30 04:22:02.156878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 210/438] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 30 04:22:02 2022] POST /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:22:02.165419 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:02.166274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:02.172478 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.172955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.173381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.174063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.174546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.174966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.201435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.204151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:02.212764 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-647f73aa-4781-46d6-856b-aed539106bc1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1265 microversion: 2.1 time: 0.108044 Aug 30 04:22:02.213445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 229/439] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:02 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:02.324286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.333196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.334671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.336249 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cbf6bc92-9aba-4d3f-b66e-ad337b579f26 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1811 microversion: 2.20 time: 0.174927 Aug 30 04:22:02.336815 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 211/440] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:02 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:02.656781 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "name": "network-vif-unplugged", "status": "completed", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:02.672980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.673799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.674484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.688181 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.compute.server_external_events [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] Unable to find a host for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242. Dropping event network-vif-unplugged {{(pid=120496) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 04:22:02.689093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-54d5b2a8-39ee-4f0f-ae51-ddfda5996038 req-77605260-dc3e-4079-bef6-3014b766fd0e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036405 Aug 30 04:22:02.691179 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 230/441] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 04:22:03.234371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:03.235664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:03.242335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.243816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.244476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:03.245125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.245765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.246421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:03.360320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:03.360926 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:03.369478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.369967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.370524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:03.371357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.371996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.372361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:03.513282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:03.522582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:03.524129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:03.525298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e43413eb-42a4-4ca5-a9f5-6755dd2f6885 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1751 microversion: 2.20 time: 0.169263 Aug 30 04:22:03.525862 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 231/442] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:03 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:03.600162 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:03.608850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83b8150c-0561-4510-a0fb-2376e2a1a694 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1271 microversion: 2.1 time: 0.379135 Aug 30 04:22:03.609449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 212/443] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:03 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1271 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:04.549494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:04.550097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:04.557249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.557732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.558189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.558898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.559341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.559756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.631054 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:04.631658 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:04.640379 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.640996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.641431 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.643865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.644528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.645173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.723277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.735244 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.737385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.742780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-26f53fd3-c87a-4299-ae68-02401052071b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1753 microversion: 2.20 time: 0.197093 Aug 30 04:22:04.760610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 232/444] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:04 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:04.823003 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23951a29-0428-458b-a6ba-5e0e1f1aec86", "tag": "1f4405ac-952c-4e37-a912-243e48be2858"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:04.833687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.840714 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.841514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.853340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] Creating event network-changed:1f4405ac-952c-4e37-a912-243e48be2858 for instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 on hv-cinder-85220 Aug 30 04:22:04.858363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-9089756d-877b-4b12-8adb-c16dfe06b595 req-94dcbdc8-27a8-44dd-b5fa-da172b59876d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044468 Aug 30 04:22:04.859041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 233/445] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:04.903279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.910862 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b3f0369e-3dfe-4a20-87ed-be33fcba46cc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.284338 Aug 30 04:22:04.911437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 213/446] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:04 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:05.455585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:05.456306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:05.462953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.463435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.463900 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:05.464675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.465236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.465741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:05.594043 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:05.602939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9d023dbf-738d-43d0-8c7b-efd1cfc857ab tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1593 microversion: 2.1 time: 0.151619 Aug 30 04:22:05.603507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 234/447] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:05 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:05.766064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:05.766813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:05.768827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:05.775514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.775997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.776433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:05.777127 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.777577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.778006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:05.909223 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:05.918475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:05.919935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:05.921093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0e609b0a-2813-4399-8e1d-2194c7e63390 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1753 microversion: 2.20 time: 0.158908 Aug 30 04:22:05.921654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 214/448] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:05 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:05.932684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:05.933297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:05.939284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.939765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.940192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:05.940882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:05.941328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:05.941745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:06.149333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:06.156908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-be925a34-68e6-45f1-9d62-38ef7e6c054b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.228727 Aug 30 04:22:06.157486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 235/449] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:05 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:06.944557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:06.945359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:06.951488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.951968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.952395 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:06.953118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.953637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.954060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.182132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:07.182940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:07.193230 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.194024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.194477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.195911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.196539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.196944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.281366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:07.299301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:07.301069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:07.302229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-089cde11-b5f4-4442-bf07-d0996f059cfb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.361688 Aug 30 04:22:07.303806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 215/450] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:06 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:07.437947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:07.446431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bc7f2984-5417-45da-a735-c5c41a253ca0 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.269358 Aug 30 04:22:07.447012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 236/451] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:07 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:07.715290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:07.725216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.726494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.727167 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.738930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] Creating event network-changed:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:22:07.744830 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-74e50365-6ca5-4327-b016-42c1d2ac9522 req-a8ba999a-0c65-4bc2-b93e-6f12ff0637b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033097 Aug 30 04:22:07.745853 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 216/452] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:08.329916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:08.332003 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:08.355594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:08.356485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:08.357308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:08.359189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:08.359991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:08.360721 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:08.469051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:08.470593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:08.482447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:08.487438 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:08.488201 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:08.489177 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:08.489850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:08.490529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:08.698235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:08.713213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.723322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.731559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.735204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-efc522aa-f574-4b9f-a784-6394e6d7b6b9 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.409917 Aug 30 04:22:08.738886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 237/453] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:08 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:08.761384 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.783340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e34f8e56-fad9-4fc2-8673-31300862d21e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.316802 Aug 30 04:22:08.795651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 217/454] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:08 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:09.307990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-282909945"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:09.308744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:09.313312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:09.320253 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.321539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.322147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.323214 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.323825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.324402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.611327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.network.security_group_api [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Adding security group 717ac52a-3f2f-4522-bdcd-7557eab93517 to port 7e166b02-3f14-40b4-b11a-1b65c4bce791 Aug 30 04:22:09.764920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:09.765702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:09.772512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.772997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.773416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.774119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.774596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.775014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.941004 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:09.950708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:09.952506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:09.953791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6e1f0236-0247-4497-a59d-81d595337a91 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.193153 Aug 30 04:22:09.954610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 218/455] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:09 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:09.974975 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:09.975580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:09.982490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.982773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.983198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.983884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.984332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.984964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.037725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7e842110-6948-457d-8f34-cf708e78723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action" status: 202 len: 0 microversion: 2.1 time: 0.735559 Aug 30 04:22:10.039600 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 238/456] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:09 2022] POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:10.048105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:10.049073 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:10.056715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.057289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.057957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.058913 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.059577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.060197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.170648 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:10.178452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-72add6e3-8052-43f0-a4df-00c516250115 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.210470 Aug 30 04:22:10.178994 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 219/457] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:09 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:10.185623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:10.195654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.196368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.196971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.208456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] Creating event network-changed:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:22:10.214392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-2c6fcdb5-fb2e-4cf0-90d2-96ca2239b402 req-57821a70-fe75-49d1-b7de-8896d23a3541 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Aug 30 04:22:10.215376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 220/458] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:10.280127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:10.291030 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-05bac356-ff09-4e88-aa28-d517d40f9731 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1639 microversion: 2.1 time: 0.246797 Aug 30 04:22:10.292326 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 239/459] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:10 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1639 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:10.982465 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:10.983149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:10.989353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.990010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.990361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.991218 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.991990 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.992708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.003323 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23951a29-0428-458b-a6ba-5e0e1f1aec86", "name": "network-vif-plugged", "status": "completed", "tag": "1f4405ac-952c-4e37-a912-243e48be2858"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:11.026709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.027480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.028147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.045455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] Creating event network-vif-plugged:1f4405ac-952c-4e37-a912-243e48be2858 for instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 on hv-cinder-85220 Aug 30 04:22:11.066344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-efaa33ce-8118-45c3-aa33-69795cacaf5b req-b61c8840-2aea-4fc9-b937-2af9eb9dc426 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066762 Aug 30 04:22:11.067363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 240/460] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:11.172900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.184993 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.186756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.188125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0a64d213-4243-4ed4-ba30-d57a55b52ede tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.210451 Aug 30 04:22:11.188690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 221/461] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:10 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:11.200282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:11.201104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:11.212733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.213328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.213844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.214665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.215190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.215700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.432006 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.441402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1d2a7208-ca85-4acb-829b-755d1e1e48c4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.246488 Aug 30 04:22:11.442008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 241/462] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:11 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:12.213397 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:12.214019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:12.220925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.221405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.221838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.222797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.223244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.223835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.365746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:12.375236 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:12.377032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:12.378634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e0d63336-3567-46d0-b47c-1654d0014a4d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.169878 Aug 30 04:22:12.379278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 222/463] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:12 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:12.462897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:12.463594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:12.470069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.470577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.471005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.471699 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.472144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.472561 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.614216 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:12.623004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-eed93191-680e-4db0-a3de-67db04a70bf1 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.164308 Aug 30 04:22:12.623574 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 242/464] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:12 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:13.402956 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:13.403698 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:13.410512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.411194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.411809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:13.412498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.412941 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.413386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:13.550929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:13.555460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:13.562421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:13.563850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:13.565009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a9e97518-6dee-4156-94af-ee31fe4d2bb5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.165960 Aug 30 04:22:13.565565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 223/465] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:13 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:13.645113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:13.645710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:13.653241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.653644 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.654069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:13.654817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.655262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.655680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:13.800459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:13.810057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3a04f6dc-d620-4403-be8b-12f576111bfb tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.169941 Aug 30 04:22:13.811258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 243/466] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:13 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:14.589995 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:14.590666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:14.598233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.599092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.599527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.600232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.600968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.601393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.745071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.753850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.755325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.756475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8dd760ab-d340-417b-b4ff-259196c47846 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.171424 Aug 30 04:22:14.757809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 224/467] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:14 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:14.831525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:14.832130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:14.839698 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.840542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.840975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.841661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.842104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.842573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.981507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.989895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-143ec56c-17ca-455e-9541-dcb5ee939363 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.162138 Aug 30 04:22:14.990986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 244/468] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:14 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:15.782476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:15.783081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:15.789775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.790290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.790733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.791443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.791894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.792315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.933081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.941731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.943208 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.944378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c8f5a5bf-f7f9-4628-8aa0-c0ceec01f92b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.166175 Aug 30 04:22:15.945145 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 225/469] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:15 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:16.011563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:16.012907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:16.020364 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.020996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.021536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.022375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.023080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.023844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.166093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:16.175298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2dbfc0d7-e5e6-49da-91bd-34a542d3e7cd tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.168187 Aug 30 04:22:16.176322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 245/470] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:16 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:16.967582 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:16.968229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:16.974766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.975241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.975762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.976742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.977190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.977647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.111757 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.121043 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.122688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.123876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-da5a3781-5d53-457e-8297-02ad1e4ba1b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.160309 Aug 30 04:22:17.124432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 226/471] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:16 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:17.197985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:17.198737 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:17.201213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:17.206866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.207344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.207773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.208512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.208984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.209404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.348904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.357890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-68bb11ab-1460-4b2a-82ea-54d1b0c5ad62 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.164421 Aug 30 04:22:17.367326 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 246/472] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:17 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:18.147191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:18.148320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:18.154901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.155371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.155794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.156474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.156913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.157323 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.294229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:18.302726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:18.304154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:18.305370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-47c34700-b0cd-4ab0-8f52-de9cf5a6d5fe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.162361 Aug 30 04:22:18.305927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 227/473] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:18 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:18.379277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:18.379880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:18.387054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.387532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.387955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.388638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.389082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.389500 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.521213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:18.529483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7bac4a45-0df6-4624-87e7-538d945c35e4 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.154086 Aug 30 04:22:18.530062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 247/474] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:18 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:19.328709 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:19.329314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.335759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.336241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.336677 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.337372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.337827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.338267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.549933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:19.550529 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.558041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.558557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.558994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.559695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.560144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.560563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.693217 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.696121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=100 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:19.703292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cec4775b-53da-4f8c-94c8-cfe2ec6c1454 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.157277 Aug 30 04:22:19.703910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 248/475] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:19 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:19.786655 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.795726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.797215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.798413 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f2e3e353-cafc-41f3-8348-8aa03f251735 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.473623 Aug 30 04:22:19.798978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 228/476] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:19 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:20.724608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:20.725213 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:20.731986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.732454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.732887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.733570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.734021 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.734478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.821620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:20.822227 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:20.828675 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.829149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.829578 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.830291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.830769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.831182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.868938 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.876729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7e7f24e4-200f-4b5c-8027-a39cc689f8f5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1313 microversion: 2.1 time: 0.156023 Aug 30 04:22:20.877306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 249/477] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:20 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:20.965783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.974381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.975927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.977014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2599621-6fb3-43f3-8992-d9266d259bf2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.160079 Aug 30 04:22:20.977576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 229/478] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:20 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:21.899366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:21.899915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:21.906333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.906812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.907242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:21.907934 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.908382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.908800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.000417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.001190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:22.008521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.009093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.009536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.010234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.010705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.011124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.046272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.055106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ab42b9c5-263f-49c2-a23e-7848d86082da tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1498 microversion: 2.1 time: 0.159367 Aug 30 04:22:22.055946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 250/479] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:21 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:22.145123 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.153955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.155421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.156568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef4e0942-2cc7-49be-8cbc-4e8db0c0e3b7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.160019 Aug 30 04:22:22.157129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 230/480] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:21 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:22.573724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.574170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:22.580067 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.580542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.580973 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.581649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.582098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.582539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.609336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:22.688780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1744c109-6edf-438b-a11b-4a996208093c tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 204 len: 0 microversion: 2.1 time: 0.118774 Aug 30 04:22:22.689382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 251/481] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:22 2022] DELETE /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:22:22.697899 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.698545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:22.704537 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.705012 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.705442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.706122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.706604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.707028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.839826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.847519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d8136d30-e89c-45a9-bb12-325223fe80bc tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1504 microversion: 2.1 time: 0.153578 Aug 30 04:22:22.848096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 231/482] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:22 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:23.181647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:23.182330 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:23.188601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.189070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.189497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.190167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.190633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.191048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.322176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:23.330740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:23.332166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:23.333300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-73cf6e3b-0c35-486d-add5-3ffa9f709086 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.156093 Aug 30 04:22:23.333843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 252/483] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:23 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:23.869067 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:23.869674 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:23.871996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:22:23.872144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Tue Aug 30 04:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 (ip 10.222.0.46) !!! Aug 30 04:22:23.878622 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.879101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.879530 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.880217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.880665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.881082 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.013095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.020884 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-30b479cb-09f9-4c43-b017-d81bc15211d3 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1504 microversion: 2.1 time: 0.155998 Aug 30 04:22:24.021448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 232/484] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:23 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:24.356676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:24.357282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:24.363707 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.364179 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.364610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.365288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.365734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.366151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.501785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.510512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.511966 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.513113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-acb5d871-6179-4511-822f-919cc1904349 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.160329 Aug 30 04:22:24.513661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 253/485] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:24 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:25.042566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:25.043160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:25.049474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.049946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.050412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.051091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.051533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.051944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.183389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.191196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-16c70bbd-5a80-43c7-858f-74299b0f9c3e tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1504 microversion: 2.1 time: 0.153046 Aug 30 04:22:25.191766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 233/486] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:25 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:25.536564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:25.537162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:25.544187 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.544450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.544695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.545388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.545837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.546275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.687110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.696467 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.697910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.699317 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-85907b6e-e545-4141-bf8f-cf163c5ca424 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.166692 Aug 30 04:22:25.700085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 254/487] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:25 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:25.922888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23951a29-0428-458b-a6ba-5e0e1f1aec86", "name": "network-vif-deleted", "tag": "1f4405ac-952c-4e37-a912-243e48be2858"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:25.934038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.934463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.934892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.947565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] Creating event network-vif-deleted:1f4405ac-952c-4e37-a912-243e48be2858 for instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 on hv-cinder-85220 Aug 30 04:22:25.952865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-b04bb42a-4806-4317-b85d-56d62aa90df2 req-5a37d4b6-3fd1-4bd5-816c-397e2bddc7ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 30 04:22:25.953475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 234/488] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:26.212557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:26.213169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:26.219252 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.219733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.220172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.220865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.221328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.221741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.255499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.255969 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.256393 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.257434 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lazy-loading 'fault' on Instance uuid 23951a29-0428-458b-a6ba-5e0e1f1aec86 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:22:26.299989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f26641d43843eebbeb4eca40f306d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca6dbede37a49528a555112bcfd816a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.308013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0fb1133f-503d-4feb-aae9-f04d343cd54b tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 200 len: 1303 microversion: 2.1 time: 0.099762 Aug 30 04:22:26.308570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 255/489] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:26 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:26.723903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:26.725244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:26.732550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.733353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.734129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.735033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.735486 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.735908 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.881335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.890973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.892683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.893838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e37a2eac-7a4e-49a6-b8ad-f14ccdf3866a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.175519 Aug 30 04:22:26.894425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 235/490] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:26 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:27.329024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:27.329759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] [instance: 23951a29-0428-458b-a6ba-5e0e1f1aec86] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:27.340148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.341007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.341756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.342499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.342954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.343395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.360538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] HTTP exception thrown: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Request method failure captured: Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 HTTP/1.1 Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZBApck8qxiBpNRAEDMG-DSbHOE65GwMfeZYcJQjnbtEn5zTayCHtUYfCJSmZc3S3DeqpolwJtyUFTAg9ny4drm_5zmU9l6RqdqNBZ7rdTeThUg3qhd7CLWS59kZWsbakG9sJMM9spcdtLaO8JTWTFtlaY6vCjjVzkEF_04mPhqzDLI Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 7ca6dbede37a49528a555112bcfd816a Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesActionsTest-388239853 Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:22:27.362209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7ca6dbede37a49528a555112bcfd816a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesActionsTest-388239853 Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 7ca6dbede37a49528a555112bcfd816a Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesActionsTest-388239853 Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesActionsTest-388239853-project Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: e2f26641d43843eebbeb4eca40f306d2 Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesActionsTest-388239853-project Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. Aug 30 04:22:27.363805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '23951a29-0428-458b-a6ba-5e0e1f1aec86'} Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:27.364638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. Aug 30 04:22:27.366056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:22:27.367949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] Returning 404 to user: Instance 23951a29-0428-458b-a6ba-5e0e1f1aec86 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:27.367949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c2405f4c-4058-4a9d-a635-948c6f637ab5 tempest-VolumesActionsTest-388239853 tempest-VolumesActionsTest-388239853-project] 10.222.0.46 "GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86" status: 404 len: 111 microversion: 2.1 time: 0.038657 Aug 30 04:22:27.367949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 256/491] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1/servers/23951a29-0428-458b-a6ba-5e0e1f1aec86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:22:27.917599 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:27.918213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:27.924626 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.925113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.925548 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.926238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.926749 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.927366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.065965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.074732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.076176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.077318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d5338e63-7cb8-4e57-975c-a4f563427473 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.164130 Aug 30 04:22:28.077880 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 236/492] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:29.101200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:29.101960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:29.108356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:29.108823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:29.109251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:29.109922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:29.110392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:29.110805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:29.243041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:29.251911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:29.253367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:29.254564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-763db295-d265-4df0-b848-5a954eefd35b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.157726 Aug 30 04:22:29.255125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 257/493] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:29 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:30.235256 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "name": "network-vif-plugged", "status": "completed", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:30.240796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:30.247909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.248395 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.248820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.261394 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] Creating event network-vif-plugged:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:22:30.266465 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-56e55896-32e2-4d14-89cc-f6f57bb0b151 req-62943682-798a-43c0-a522-81a103a4b03f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034928 Aug 30 04:22:30.267064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 237/494] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:30.277676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.278334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.284588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.285065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.285515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.286288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.286806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.287198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.420855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.429908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.431576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.432763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-799b6c0e-c0d3-4076-a53e-b9ce9998773e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.158903 Aug 30 04:22:30.433327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 258/495] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:30.729398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "731b95ab-c694-4a2b-9cb4-8e466897fdef"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:30.732095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.739270 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.740076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.740638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.741927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.742485 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.742921 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.456080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:31.456630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:31.463310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:31.464054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:31.464480 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.465271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:31.465603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:31.466015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.588731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7bd3dea2-36da-468b-b323-102e1458182f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864082 Aug 30 04:22:31.589660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 238/496] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:22:30 2022] POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:31.633207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.642907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.644338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.645659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-60aa87a4-f088-4884-99f6-506012286758 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.193553 Aug 30 04:22:31.646751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 259/497] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:31 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:22:32.670972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.672463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:32.692909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.693404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.693874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.700994 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.701477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.701937 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.878108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:32.888402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:32.890294 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:32.891680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-839ddcc2-a54e-4224-b0ce-7c73b955ab81 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.225881 Aug 30 04:22:32.892527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 239/498] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:33.921119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:33.922515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:33.930804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.931638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.932290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.933215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.933900 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.934686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.093081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.103821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.106477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.107950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7c53ed4e-c983-4566-88cd-c3a0fe6c1460 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1809 microversion: 2.20 time: 0.190694 Aug 30 04:22:34.108700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 260/499] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:33 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:35.133561 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.134174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.149212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.150050 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.151239 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.152047 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.152535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.153391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.184871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:35.332180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:35.343220 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:35.344786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:35.346623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-667cfa98-a8f4-4b58-90a3-4f3a573bb4c1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1796 microversion: 2.20 time: 0.217742 Aug 30 04:22:35.347400 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 240/500] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1796 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:35.598185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.598944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.606734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.607465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.608054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.608943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.609548 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.610169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.762857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lazy-loading 'services' on Instance uuid daa060fe-649e-4f72-9288-d7d92a36e037 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:22:35.932580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-707ff5c6-39cc-4eae-a532-ee256838e3ef tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments/6055b1c8-4deb-4afd-9070-695a563ca5bd" status: 202 len: 0 microversion: 2.1 time: 0.338254 Aug 30 04:22:35.933812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 261/501] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:22:35 2022] DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments/6055b1c8-4deb-4afd-9070-695a563ca5bd => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:39.442061 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:39.446847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:39.455056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.455620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.456267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.457101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.457804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.458380 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.494914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'flavor' on Instance uuid b08fcdf7-05cc-4789-981c-cb67b796f1bc {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:22:39.648190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f2c4f951-bb24-4a22-9962-93fe47465f38 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/action" status: 200 len: 32 microversion: 2.1 time: 0.210166 Aug 30 04:22:39.649216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 241/502] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:39 2022] POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:22:39.660550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:39.661243 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:39.675980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.676779 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.677870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.679836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.680476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.681063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.861805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:39.872541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b99eae5b-3125-4d3f-8c79-fadc296cc8f1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.216844 Aug 30 04:22:39.873939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 262/503] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:39 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:40.325241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:40.332764 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.333491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.334199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.371958 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Going to try to stop instance {{(pid=120495) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:22:40.437044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-34a49ff0-5203-4162-b8d3-485e45b955ab tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action" status: 202 len: 0 microversion: 2.1 time: 0.116090 Aug 30 04:22:40.437862 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 242/504] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:40 2022] POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:40.448484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:40.449512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:40.458129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.459125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.462475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.463775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.464428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.465028 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.484278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:40.640526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:40.648947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0273a4cc-c240-4a0c-b277-c80acdba1667 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.206603 Aug 30 04:22:40.650733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 263/505] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:40 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:40.904436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:40.907457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:40.915191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.916021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.916553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.917297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.917732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.918157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:41.068355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:41.078124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-69ef4e16-44c6-4813-bec5-8f2ce01ddbcb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.177897 Aug 30 04:22:41.081043 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 243/506] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:40 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:41.672424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:41.673359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:41.679978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:41.680354 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:41.680825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:41.681460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:41.681893 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:41.682343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:41.845989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:41.854721 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b67adef9-8804-4e51-acbc-639eaef8113b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.186398 Aug 30 04:22:41.855615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 264/507] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:41 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:42.103448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:42.104130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:42.112834 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.113687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.114653 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.116042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.117086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.117900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.289732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:42.304202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-46ab8330-0423-4802-9bf3-33b34f203130 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.206205 Aug 30 04:22:42.304782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 244/508] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:42 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:42.876447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:42.877540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:42.885082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.885941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.886630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.887716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.888247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.888780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:43.252580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:43.271096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bd6c8c90-b074-42af-87c4-5269bb0ef3e9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.398469 Aug 30 04:22:43.272094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 265/509] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:42 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:43.327507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:43.328160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:43.335570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:43.336567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:43.337175 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:43.337893 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:43.338367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:43.338790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:43.512962 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:43.521921 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a4a9bcaa-3da7-4728-8a31-dcd33c612765 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.198443 Aug 30 04:22:43.522810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 245/510] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:43 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:44.295670 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:44.296296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:44.303150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.304009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.304778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:44.306282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.307586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.308310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:44.458661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:44.467467 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f1c02c6a-e37a-4abb-bc6d-044cff43d093 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.176765 Aug 30 04:22:44.468042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 266/511] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:44 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:44.545135 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:44.546057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:44.554163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.554697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.555133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:44.556019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.556475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.556894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:44.704832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:44.715173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-84314fea-237d-4a16-b84e-9c18b8d2a051 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.173998 Aug 30 04:22:44.716456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 246/512] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:44 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:45.489032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:45.489795 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:45.497325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:45.497704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:45.498129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:45.498866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:45.499304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:45.499720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:45.651697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:45.660102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1daed6c9-7769-41f1-baaa-67c350963805 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.174886 Aug 30 04:22:45.674769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 267/513] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:45 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:45.738163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:45.738903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:45.746510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:45.746999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:45.747492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:45.748136 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:45.748591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:45.749080 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:45.895319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:45.906856 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cbf81172-3190-4f29-a3ac-b9cd94ece875 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.173262 Aug 30 04:22:45.907745 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 247/514] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:45 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:46.683851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:46.684482 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:46.691494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.691971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.692400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:46.693090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.693539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.693951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:46.847202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:46.856927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e600ecea-a40c-4da7-8ad9-dc5c9d223f4f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.176902 Aug 30 04:22:46.862751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 268/515] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:46 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:46.928934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:46.929918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:46.937828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.938643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.939334 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:46.940086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.940544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.940968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:47.096918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:47.107768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-38daeab1-66a5-43d0-999f-33cfbcd8abb9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.183155 Aug 30 04:22:47.108701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 248/516] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:46 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:47.883149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:47.884199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:47.888893 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:47.892904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:47.893379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:47.893802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:47.894550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:47.895652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:47.896673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:48.052977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:48.061447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2b8dfb0e-a437-4aed-81b1-d847a418226e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.185153 Aug 30 04:22:48.062017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 269/517] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:47 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:48.130803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:48.131423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:48.145199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:48.145199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:48.145199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:48.145199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:48.145831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:48.145831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:48.285537 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:48.295173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3a6a1c7b-36c0-4e3f-a4fe-ece2f15cb47e tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.168331 Aug 30 04:22:48.295736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 249/518] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:48 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:49.083462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:49.084072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:49.090677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.091156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.091585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.092270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.092717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.093137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.221572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:49.229230 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a32418e0-21df-4fb2-8c04-a5c9f321e5e5 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.149623 Aug 30 04:22:49.229799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 270/519] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:49 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:49.317307 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:49.317915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:49.325008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.325482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.325914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.326628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.327079 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.327494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.458419 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:49.467228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4c247c6f-9d28-4896-9aec-95c0e223d5c5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.153804 Aug 30 04:22:49.467805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 250/520] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:49 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:50.250158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:50.250790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:50.257264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.257735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.258221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.258930 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.259375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.259790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.390343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:50.398747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-80de00c4-9ff6-48f4-b237-98021f397032 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1677 microversion: 2.1 time: 0.152394 Aug 30 04:22:50.399339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 271/521] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:50 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:50.488723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:50.489237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:50.496135 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.496608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.497037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.497715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.498156 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.498596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.627557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:50.636569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-705c6376-b6aa-418e-ba56-33dc6bc345a5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.152078 Aug 30 04:22:50.637133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 251/522] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:50 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:51.420236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:51.420846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:51.437869 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.438389 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.438829 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.439868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.440328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.440753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.592768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:51.601035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-35057d76-3618-4fd8-93ea-998bf259cb4e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1654 microversion: 2.1 time: 0.184604 Aug 30 04:22:51.601712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 272/523] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:51 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1654 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:51.622202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:51.628657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.629171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.629606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.654577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Going to try to start instance {{(pid=120495) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:22:51.661202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:51.661821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:51.669603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.670390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.670826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.671747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.672352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.672933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.700269 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bdbdd1eb-1e70-4e80-bd3c-712bc653347f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action" status: 202 len: 0 microversion: 2.1 time: 0.081757 Aug 30 04:22:51.700990 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 252/524] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:51 2022] POST /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:51.711120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:51.711857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:51.718335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.719031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.719629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.720484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.721172 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.721636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.726652 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:51.829338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:51.839574 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-634d1f41-15da-4ea0-9adc-cca30c6f2ce8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.184130 Aug 30 04:22:51.840225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 273/525] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:51 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:51.993261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:52.001209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0a4968a6-ce1a-41f7-bc5f-14b3aba36ae9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1663 microversion: 2.1 time: 0.295098 Aug 30 04:22:52.001806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 253/526] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:51 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1663 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:52.860884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:52.861508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:52.868088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:52.868559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:52.869011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:52.869665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:52.870107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:52.870552 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.008572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:53.016632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-52cf7685-4677-4171-9d32-239756661ce4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.159599 Aug 30 04:22:53.017466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 274/527] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:52 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:53.023878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:53.024481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:53.030948 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.031426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.031855 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.032536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.032979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.033393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.122441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:53.124945 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:53.131250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.131466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.132041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.132731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.133171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.133591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.162775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:53.172496 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c8595087-4104-410f-a827-0f36820bc9ae tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1667 microversion: 2.1 time: 0.153128 Aug 30 04:22:53.173072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 254/528] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:53 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:53.205433 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6ff48fd8-b151-4428-9aa3-f110164ec9a5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action" status: 202 len: 0 microversion: 2.1 time: 0.086686 Aug 30 04:22:53.208374 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 275/529] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:53 2022] POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:22:53.214839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:53.215491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:53.221517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.221989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.222441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.223122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.223562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.223974 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.372932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:53.382240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1713a6d0-a822-43b2-ad49-37a9bf0a723e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1749 microversion: 2.1 time: 0.170562 Aug 30 04:22:53.382865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 255/530] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:53 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:54.042776 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:54.043472 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:54.049674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:54.050153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:54.050626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:54.051314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:54.051790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:54.052209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:54.185928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:54.194561 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-653390fb-b597-4a4d-8e57-9610a971b830 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.157271 Aug 30 04:22:54.195384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 276/531] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:54 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:54.404944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:54.405580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:54.411988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:54.412515 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:54.413508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:54.414328 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:54.414782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:54.415194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:54.555519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:54.563598 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-79491030-79b0-46b5-951c-28ed434c2822 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.162557 Aug 30 04:22:54.564161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 256/532] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:54 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:55.216197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.216796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:55.223146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.223627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.224051 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.224725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.225207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.225601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.359007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:55.367292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-65fe2892-fa3f-4c82-a039-4ea43a9d0d63 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.154948 Aug 30 04:22:55.367854 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 277/533] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:55.588490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.589201 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:55.595547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.596017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.596442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.597109 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.597551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.597962 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.742412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:55.750612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-02c71af6-31eb-4f3c-85f0-d54e82753d9c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.165869 Aug 30 04:22:55.751184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 257/534] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:56.388513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:56.389113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:56.395738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.396208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.396632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.397307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.398344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.398801 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.529918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:56.537982 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-170dfa79-b649-4672-9951-8e0fa928b258 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.153461 Aug 30 04:22:56.538565 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 278/535] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:56 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:56.773745 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:56.774452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:56.780569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.781038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.781461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.782137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.782599 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.783007 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.924650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:56.933672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-234f7549-d941-4889-8055-e4d710170b8b tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.164447 Aug 30 04:22:56.934337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 258/536] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:56 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:57.559563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:57.560098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:57.566452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:57.566931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:57.567362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:57.568045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:57.568492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:57.568911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:57.573012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:57.700289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:57.708353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e4566fa-2652-4ea1-af82-c297fe97eda9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.152804 Aug 30 04:22:57.708906 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 279/537] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:57 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:57.955860 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:57.956461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:57.963871 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:57.964346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:57.964782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:57.965472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:57.965930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:57.966378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:58.107482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:58.115651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e5bbeec8-c4d4-4817-a772-d1d396f7d68c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.163779 Aug 30 04:22:58.116221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 259/538] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:57 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:58.729899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:58.730525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:58.737061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:58.737530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:58.737953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:58.738662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:58.739107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:58.739522 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:58.873783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:58.881962 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e8e20926-2a17-4dd5-9085-fd8e489f7522 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1734 microversion: 2.1 time: 0.155966 Aug 30 04:22:58.882723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 280/539] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:58 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:59.139411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:59.140023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:59.146742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.147221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.148197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.149307 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.149761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.150185 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.295601 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:59.303706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0f840297-5e30-4caa-aaa4-fba7db65505e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.170080 Aug 30 04:22:59.304379 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 260/540] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:59 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:59.903649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:59.904257 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:59.910788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.911270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.911704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.912392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.912942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.913292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.042231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:00.050399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8ab135d9-4d60-42e1-bd43-e4173d5601b2 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1714 microversion: 2.1 time: 0.150575 Aug 30 04:23:00.050963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 281/541] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:59 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:00.160464 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:00.161049 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:00.167750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.168234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.168669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.169356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.169806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.170228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.294758 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] HTTP exception thrown: Cannot 'detach_volume' instance b08fcdf7-05cc-4789-981c-cb67b796f1bc while it is in vm_state rescued Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Request method failure captured: Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments/731b95ab-c694-4a2b-9cb4-8e466897fdef HTTP/1.1 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-3p5Xep934iUwstV6JMI33GcM9tIURT6ogzaAWeN5fk0Q5wgh518eMu_THo6zrtAvvhE_dKof3_P39EubOVwO19zOP-QfWiS5-N2d65ZFUuHk-ciiBUB8qQO4HQFeteyu83sL3yWom8ZXsFlRpxni7pXN5sPRWlsU0hzCY-3KXxuA Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:23:00.296349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: eb61948f41344ea481024a96cf03db37 Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:23:00.297906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Cannot 'detach_volume' instance b08fcdf7-05cc-4789-981c-cb67b796f1bc while it is in vm_state rescued Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'server_id': 'b08fcdf7-05cc-4789-981c-cb67b796f1bc', 'id': '731b95ab-c694-4a2b-9cb4-8e466897fdef'} Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:00.298666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b08fcdf7-05cc-4789-981c-cb67b796f1bc while it is in vm_state rescued Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b08fcdf7-05cc-4789-981c-cb67b796f1bc while it is in vm_state rescued Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:23:00.299920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Returning 409 to user: Cannot 'detach_volume' instance b08fcdf7-05cc-4789-981c-cb67b796f1bc while it is in vm_state rescued {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:00.301098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8d4b313d-975d-46af-83a6-57f0d12da5ec tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments/731b95ab-c694-4a2b-9cb4-8e466897fdef" status: 409 len: 152 microversion: 2.1 time: 0.141298 Aug 30 04:23:00.301098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 261/542] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:23:00 2022] DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments/731b95ab-c694-4a2b-9cb4-8e466897fdef => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:00.307327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:00.307855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:00.313648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.314124 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.314589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.315270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.315715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.316131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.325718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:00.326359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:00.328185 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=50 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:00.333606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.334091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.334568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.335260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.335710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.336126 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.388170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2b23a2fc-8e7b-4e11-b7b4-bef4c48ff9dc tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/action" status: 202 len: 0 microversion: 2.1 time: 0.085089 Aug 30 04:23:00.389047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 282/543] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:00 2022] POST /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:00.398798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:00.399729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:00.406275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.407334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.407334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.407921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:00.408449 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:00.408919 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:00.534482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:00.544056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3a0c3132-0b2e-4ede-8bbe-34b1dca6a3d3 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.222917 Aug 30 04:23:00.544854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 262/544] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:00 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:00.561293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:00.569559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-29dbca39-a576-4af6-a354-04a00daa6c54 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1722 microversion: 2.1 time: 0.175730 Aug 30 04:23:00.570598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 283/545] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:00 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:01.565896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:01.566444 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:01.573588 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.574067 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.574646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.575333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.575780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.576198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.590801 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:01.591414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:01.597822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.598499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.599132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.599621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.600071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.600504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.719743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:01.728578 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f0a26260-dfc9-4476-8d23-a3db7a999d37 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.166588 Aug 30 04:23:01.729155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 263/546] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:01 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:01.733265 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:01.742102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ae0d8317-ac64-4437-a9cc-aaa6edf1a89f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1722 microversion: 2.1 time: 0.154677 Aug 30 04:23:01.742806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 284/547] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:01 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:02.750331 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:02.750931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:02.757934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.758516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.759031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.759725 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.760178 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.760594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.763710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:02.764318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:02.770979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.771456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.771887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.772580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.773843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.774388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.907160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:02.907811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:02.916044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b504b75c-94a0-4ca5-9a1f-5fb87bcc3f6c tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.169606 Aug 30 04:23:02.916211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0d4a511b-c2ea-4a2a-859f-52b17db73f95 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1722 microversion: 2.1 time: 0.156043 Aug 30 04:23:02.916613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 264/548] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:02 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:02.916751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 285/549] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:02 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:03.936951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:03.937643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:03.938032 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:03.938139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:03.944051 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.944197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.944560 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.944788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.945121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:03.945528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:03.945849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.946235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.946373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.946708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.946829 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:03.947128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:04.083709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:04.096681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8f203645-e491-47c6-b55c-61bd52ca623c tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1728 microversion: 2.1 time: 0.163527 Aug 30 04:23:04.097268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 286/550] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:03 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:04.098344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:04.106835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef5413a1-214d-4371-944c-61a248613dc5 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.173315 Aug 30 04:23:04.107399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 265/551] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:03 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:04.117443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:04.117990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:04.124089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:04.124568 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:04.124998 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:04.125678 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:04.126126 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:04.126570 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:04.206416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-28740452-0d0d-469e-804f-d7a901897bc4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092781 Aug 30 04:23:04.207005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 287/552] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:23:04 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:05.093251 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:05.103768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.104553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.104685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.115748 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] Creating event network-changed:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:23:05.123298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6e671c73-ae31-48df-9f31-b4b0ac5113fa req-69f82508-8a7d-44d4-b8b3-cc0ad870ab00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Aug 30 04:23:05.123298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 266/553] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:05.128251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:05.128861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:05.136250 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.136974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.137580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.138792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.139436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.140047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.295320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:05.303777 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-43471edf-7207-4f4f-89d5-9736529f594f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.179236 Aug 30 04:23:05.304753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 288/554] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:05 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:06.326163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:06.326883 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:06.333014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:06.333490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:06.333944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:06.334670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:06.335150 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:06.335571 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:06.482411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:06.490519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-20d6cbfc-6dce-4e22-a7a6-5b415cf840b1 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.168989 Aug 30 04:23:06.491023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 267/555] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:06 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:07.138995 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:07.150103 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.150596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.151035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.161872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] Creating event network-changed:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:23:07.167500 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c6998f83-b4c4-412d-bc00-e8a335ec72f5 req-650c2bd6-a3a7-4036-9bd1-a8141b633165 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032189 Aug 30 04:23:07.168093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 289/556] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:07.513119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:07.513816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:07.520473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.520953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.521383 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.522066 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.522581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.523009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:07.762235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-35ac7514-8cd4-4035-ac3e-ded53e797c11 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.252963 Aug 30 04:23:07.762834 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 268/557] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:07 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:08.785262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.785954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:08.792592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.793072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.793501 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.794182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.794657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.795078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.942119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.950822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d04ecf0d-3d6f-4f21-a12e-5bcfe0419443 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.170289 Aug 30 04:23:08.951386 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 290/558] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:09.971224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:09.971836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:09.978736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.979216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.979651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.980334 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.980783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.981202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.127263 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:10.135640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b0108842-c8e3-46b9-a450-f03b447b984f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1754 microversion: 2.1 time: 0.168270 Aug 30 04:23:10.136217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 269/559] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:09 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:11.156300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:11.156890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:11.163487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.163968 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.164399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.165080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.165524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.165939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.309675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.317730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-72c7f7cd-91f9-492a-9715-7393da791608 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1757 microversion: 2.1 time: 0.165303 Aug 30 04:23:11.318307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 291/560] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:11 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:16.836565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.837114 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.843671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.844147 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.844579 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.845268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.845718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.846133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.864428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=100 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:16.879085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3a6e0eb8-8e61-4e6f-a1e3-2a9a5241aabf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments/73d35711-a2df-4954-9cae-d709f360e434" status: 200 len: 194 microversion: 2.20 time: 0.046535 Aug 30 04:23:16.879675 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 270/561] 10.222.0.46 () {60 vars in 1454 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments/73d35711-a2df-4954-9cae-d709f360e434 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:23:16.955363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.959553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.966795 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.967282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.967950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.968662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.969116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.969541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.060557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lazy-loading 'services' on Instance uuid a3ff227a-e878-4f20-b2e7-1d0fac6fb242 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:23:17.138630 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e594dd63-a676-4268-84dd-e2109175d3e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments/73d35711-a2df-4954-9cae-d709f360e434" status: 202 len: 0 microversion: 2.20 time: 0.188144 Aug 30 04:23:17.139279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 292/562] 10.222.0.46 () {60 vars in 1457 bytes} [Tue Aug 30 04:23:16 2022] DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments/73d35711-a2df-4954-9cae-d709f360e434 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:17.148917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.151190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:17.157094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.157584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.158157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.158912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.159367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.159788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.196921 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ae98940c-3a7c-4d6f-b52e-35becd6776b6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052779 Aug 30 04:23:17.197494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 271/563] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:23:18.213584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.215911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.217824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=48 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:18.223196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.223678 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.224113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.224798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.225247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.226226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.256388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9af47d09-8cce-4369-94ea-2096c31a856c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048524 Aug 30 04:23:18.257527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 293/564] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:18.320087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.320805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.327203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.327683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.328110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.328790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.329236 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.329654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.355545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:18.440593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a37e2850-c201-468c-99e5-1cb0b6ff9543 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 204 len: 0 microversion: 2.20 time: 0.124788 Aug 30 04:23:18.441177 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 272/565] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 30 04:23:18 2022] DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:23:18.449931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.450604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.456563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.457039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.457700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.458296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.458740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.459161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.589116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.597242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.598729 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.599899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2f408823-4483-4b69-84a5-55704111aa8f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.153862 Aug 30 04:23:18.600465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 294/566] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:19.624350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:19.625032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:19.631653 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.632906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.633394 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.634089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.634570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.634991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.765597 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.774743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.776179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.777441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ff07b5ac-266e-4423-89cb-f5795c4f57ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1724 microversion: 2.20 time: 0.157449 Aug 30 04:23:19.778007 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 273/567] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:19 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:20.800562 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:20.801210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:20.808278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.808768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.809208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.809914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.810383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.810808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.816369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:20.885580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.894282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.895781 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.896990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8155cf41-5fd2-4552-8458-b35de4e13da6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 200 len: 1657 microversion: 2.20 time: 0.100246 Aug 30 04:23:20.912527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 295/568] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:20 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 1657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:21.167907 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ff227a-e878-4f20-b2e7-1d0fac6fb242", "name": "network-vif-deleted", "tag": "878113b7-0721-4ab0-9707-08eb2f973e55"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:21.179365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.180152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.180549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.194418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] Creating event network-vif-deleted:878113b7-0721-4ab0-9707-08eb2f973e55 for instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 on hv-cinder-85220 Aug 30 04:23:21.199716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-3713f936-090d-4809-8811-af7d669b328d req-b0456eb4-aced-4245-bc7d-c49b1f714760 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036206 Aug 30 04:23:21.200322 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 274/569] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:21.921024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.922401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:21.930029 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.930616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.931269 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.932166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.932785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.933365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.949362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 HTTP/1.1 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:23:21.951395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:23:21.952935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a3ff227a-e878-4f20-b2e7-1d0fac6fb242'} Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:21.953784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:23:21.955136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:21.956247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:21.956247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2c2a94e6-7198-4e04-b1d6-fa488ef6c8d1 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 404 len: 111 microversion: 2.20 time: 0.036012 Aug 30 04:23:21.963214 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-66e61549-4d64-450d-b4be-c0aa341cf5ee tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '.version_select at 0x7faa0d556c10>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.963572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 296/570] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:21 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:23:21.990848 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-66e61549-4d64-450d-b4be-c0aa341cf5ee tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667504083" status: 204 len: 0 microversion: 2.20 time: 0.032420 Aug 30 04:23:21.991963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 275/571] 10.222.0.46 () {60 vars in 1262 bytes} [Tue Aug 30 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667504083 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:23:22.713904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b5d0eb9f-3a8f-4ff3-a2df-89180b475e28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: .version_select at 0x7faa0d7185e0>, body: {"keypair": {"name": "tempest-keypair-2045796388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC57yJnIp3nnO23kQpStNt15cgBxrRettdjqU/EXtrGOs+fOIkfT/BzoRUuWXd7yU0lbd7hCwyue+jiQbKo6FWwDjTvfcHm/GwtZG3rqzCjTBK3BqZkvnaZCxdYv/dI3Pg=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:22.729494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-b5d0eb9f-3a8f-4ff3-a2df-89180b475e28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for project 411b8da28bed456bbdcdb01587610b47. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:22.733375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-b5d0eb9f-3a8f-4ff3-a2df-89180b475e28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for user 8c30ec9810204a4685590c42707e41f8 and project 411b8da28bed456bbdcdb01587610b47. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:22.755897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b5d0eb9f-3a8f-4ff3-a2df-89180b475e28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046155 Aug 30 04:23:22.756509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 297/572] 10.222.0.46 () {62 vars in 1200 bytes} [Tue Aug 30 04:23:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:23:24.120612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1353149140", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac6df5cf-677b-40fd-8aa9-efd2a9db3cd6"}], "security_groups": [{"name": "tempest-securitygroup--446806292"}], "key_name": "tempest-keypair-2045796388", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:24.224942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] validate_networks() for [('ac6df5cf-677b-40fd-8aa9-efd2a9db3cd6', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:23:24.603814 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:24.604256 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:24.604726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:24.605130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:24.605551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:24.614361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.614842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.615272 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.615996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.617132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.617559 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.634735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for project 411b8da28bed456bbdcdb01587610b47. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:24.638697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Getting quotas for user 8c30ec9810204a4685590c42707e41f8 and project 411b8da28bed456bbdcdb01587610b47. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:24.650229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:24.652632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:24.698130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c7004bda-4cc9-4c3d-9b72-f35cf155bd28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.582915 Aug 30 04:23:24.698850 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 276/573] 10.222.0.46 () {62 vars in 1188 bytes} [Tue Aug 30 04:23:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:23:24.711042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:24.711782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:24.769286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.777203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.778702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.779792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3885fbc7-70f5-499e-962f-de4de5378db6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1282 microversion: 2.20 time: 0.074009 Aug 30 04:23:24.780346 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 298/574] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:24 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:25.803443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:25.804765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:25.812356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.812842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.813471 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.814187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.814671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.815261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.902890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.911704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.913410 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.914633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b174d087-8eab-40bc-b158-b7ca191c81fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1334 microversion: 2.20 time: 0.115675 Aug 30 04:23:25.916019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 277/575] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:25 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1334 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:26.937262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.939099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.948261 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.949112 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.949551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.951040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.951659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.952275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.095650 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.105467 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.106928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.108064 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6f7a54df-14be-4593-bec1-b7cea4fcbd3b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.174692 Aug 30 04:23:27.108627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 299/576] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:27.477031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:27.494054 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.494640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.494978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.505892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] Creating event network-changed:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:23:27.513845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-897fd2e7-a5f8-424d-9e09-d4a47d09282e req-9b5cea31-4542-4c11-8ee6-f2cfb832e72c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040373 Aug 30 04:23:27.514558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 278/577] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:28.130144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:28.130775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:28.137791 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.138303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.138768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.139459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.139907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.140338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.274043 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.282488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.283946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.285045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d35d3205-acb2-4641-912e-d1cf8702c156 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.158746 Aug 30 04:23:28.285616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 300/578] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:28 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:29.309746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.310463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.318276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.318771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.320352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.321066 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.322170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.322834 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.481239 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.489255 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.490719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.491808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8049cfa5-8031-40a4-8f5a-34bd04df9f7e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.187728 Aug 30 04:23:29.492368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 279/579] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:30.515693 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.516306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.523025 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.523503 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.523933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.524692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.525448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.525968 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.658204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.667541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.669005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.670111 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-43c367ff-6241-4741-9361-f7de2d47c188 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.158351 Aug 30 04:23:30.670701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 301/580] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:31.692454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.693059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:31.695636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:31.706042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.706554 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.706981 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.707665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.708107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.708523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.842797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.850971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.852427 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.854077 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-86ab0a05-0164-44d4-afeb-5edc0a603ef3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.165474 Aug 30 04:23:31.854715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 280/581] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:32.425215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.427622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.434345 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.434826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.435258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.435944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.436397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.436818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.467351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-95cd4d7d-953b-42c1-b051-f2ff95eb2fc1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046079 Aug 30 04:23:32.467910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 302/582] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:23:32.532471 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.532989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.538989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.539458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.539891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.540596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.541034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.541442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.565420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:32.644082 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d025235a-90ac-461b-865e-7abab12b74b3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 204 len: 0 microversion: 2.1 time: 0.115158 Aug 30 04:23:32.644646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 281/583] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:32 2022] DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:32.653479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.654084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.660319 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.660806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.661238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.661930 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.662411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.662835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.795763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.804361 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e9a9b438-3b2a-4f5a-8465-e5d8375787b0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1673 microversion: 2.1 time: 0.155514 Aug 30 04:23:32.804934 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 303/584] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:32.877617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.878387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.885683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.886180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.886639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.887320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.887769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.888183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.018521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.026932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.028374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.029476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d369cb39-7fe8-4193-a4f7-c91ee6435f68 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.156154 Aug 30 04:23:33.030035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 282/585] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:33.559140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "name": "network-vif-plugged", "status": "completed", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:33.568889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.569348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.569754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.581248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] Creating event network-vif-plugged:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:23:33.586183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-9ce1dc57-1e67-407c-9004-d8097a0ab1c4 req-4ce47796-68da-46c5-bf2b-c86a6810b425 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Aug 30 04:23:33.587013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 304/586] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:33.826886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:33.827497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:33.833402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.833878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.834351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.835030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.835480 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.835901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.974665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.982422 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9f5680ee-3ea4-457b-91d4-6b8cb4e1c8a9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1673 microversion: 2.1 time: 0.159365 Aug 30 04:23:33.983011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 283/587] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:33 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:34.051967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:34.052652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:34.058711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.059184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.059608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.060286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.060727 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.061140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.192158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.200896 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.202369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.203455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-08183166-c6a2-4c78-a67a-7c65706fc88d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.155711 Aug 30 04:23:34.204000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 305/588] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:35.003910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.004517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.006491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:35.007149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:35.014164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.014673 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.015111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.015804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.016254 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.016672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.225233 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:35.225729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.231235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.232095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.234207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e2af581c-9214-4261-983d-c15c3c152e8d tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1673 microversion: 2.1 time: 0.234261 Aug 30 04:23:35.248151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 284/589] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.248350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.248350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.248350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.248350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.248727 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.248727 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.391871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.401308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.403161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.404459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-48d7ae64-5641-4118-907f-1b84a9275771 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.182840 Aug 30 04:23:35.405220 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 306/590] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:35.986000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa060fe-649e-4f72-9288-d7d92a36e037", "name": "network-vif-deleted", "tag": "b8e75002-6c9d-47c3-a24b-44a2b69a1fc6"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:35.996180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.996651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.997065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.008151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] Creating event network-vif-deleted:b8e75002-6c9d-47c3-a24b-44a2b69a1fc6 for instance daa060fe-649e-4f72-9288-d7d92a36e037 on hv-cinder-85220 Aug 30 04:23:36.013703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-9f7682fa-1460-4799-b0da-f6f04bc33f01 req-1d10ac60-28c2-45d7-b786-9e407ad783dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Aug 30 04:23:36.014315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 285/591] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:36.256268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.256975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.263742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.264312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.264798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.265495 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.265939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.266383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.335000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.343713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9a7c37f3-bee9-45bc-9bc7-1edf324f5e26 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 200 len: 1605 microversion: 2.1 time: 0.092199 Aug 30 04:23:36.344618 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 307/592] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 1605 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:36.429425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.430231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.438513 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.439006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.439440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.440143 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.440594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.441013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.662888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.679549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.682040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.683932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94839c09-5656-44cb-a551-f095e6e8d433 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1407 microversion: 2.20 time: 0.259749 Aug 30 04:23:36.685490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 286/593] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:37.370668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.371254 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.380103 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.380802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.381573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.382887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.383436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.383907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.403375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 HTTP/1.1 Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:23:37.405009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:23:37.406489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'daa060fe-649e-4f72-9288-d7d92a36e037'} Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:37.407278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:23:37.408511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:37.409657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:37.409657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aeae084a-ee7a-4579-91b5-6986f9385eea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 404 len: 111 microversion: 2.1 time: 0.040703 Aug 30 04:23:37.409657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 308/594] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:37.415567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1f0c1bfb-ded9-4b43-a5da-5d4c0ff93d96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '.version_select at 0x7faa0d596430>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.435533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1f0c1bfb-ded9-4b43-a5da-5d4c0ff93d96 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801178513" status: 202 len: 0 microversion: 2.1 time: 0.023825 Aug 30 04:23:37.436102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 287/595] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 30 04:23:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801178513 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:37.709433 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.709947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.716472 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.716953 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.717439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.718234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.718742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.719176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.908066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.916895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.918368 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.919512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-26c8d53d-5c63-4247-a36e-123012f6cb37 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1600 microversion: 2.20 time: 0.214500 Aug 30 04:23:37.920066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 309/596] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:37.941740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.942227 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.948649 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.949124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.949550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.950231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.950694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.951111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.967639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:38.035549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f6f3dff2-f99d-4f1f-a1f0-032aa37f8228 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097630 Aug 30 04:23:38.036354 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 288/597] 10.222.0.46 () {60 vars in 1316 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:23:38.351804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f24a5245-b96e-4c2c-8774-b695df1d5cb8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: .version_select at 0x7faa0d6bf430>, body: {"keypair": {"name": "tempest-keypair-1585378442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUBTB7rZzrDJNPoPoKkWN6hJhjnE0LBs6a99XbMcKfRVcz0v6UnfCgf8lA83TgowjiDEKpquD3OJvrX9gSWHuSI4rzhbQBj83aVTtBJTVWvt+DoXOM/64oxxybAt7TNwA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:38.369379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-f24a5245-b96e-4c2c-8774-b695df1d5cb8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:38.373648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-f24a5245-b96e-4c2c-8774-b695df1d5cb8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for user 96d18f6efa1f4c91a6f213c095c507a3 and project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:38.398376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f24a5245-b96e-4c2c-8774-b695df1d5cb8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050346 Aug 30 04:23:38.399123 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 310/598] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:23:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:39.386088 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:39.396347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.396822 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.397245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.409649 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] Creating event network-changed:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:23:39.415365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-b5b0cdb4-5d5b-44ba-88f5-7bbc9baf4678 req-f61cc6a1-909d-4c21-9dc5-8dbdfab0f4ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034976 Aug 30 04:23:39.416087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 289/599] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:39.969780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1402695083", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f55c98a9-cbed-4af8-92a6-c49957223dcb"}], "security_groups": [{"name": "tempest-securitygroup--1311996724"}], "key_name": "tempest-keypair-1585378442", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:40.077102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] validate_networks() for [('f55c98a9-cbed-4af8-92a6-c49957223dcb', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:23:40.476626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:40.477045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:40.477585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:40.477979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:40.479405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:40.487905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.488405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.488893 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.489636 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.490084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.490519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.512123 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:40.516210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Getting quotas for user 96d18f6efa1f4c91a6f213c095c507a3 and project 5a89b6f21ff24eafbed378c2ece79c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:40.527806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:40.530106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:40.578888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9a0adee0-1523-4de6-acba-8cb2282e4851 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613866 Aug 30 04:23:40.585478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 311/600] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:23:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:23:40.593263 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b4185ca8-8d81-43fa-84af-a8bc419e2fa2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.594170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b4185ca8-8d81-43fa-84af-a8bc419e2fa2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.651436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b4185ca8-8d81-43fa-84af-a8bc419e2fa2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.658260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b4185ca8-8d81-43fa-84af-a8bc419e2fa2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1238 microversion: 2.1 time: 0.071109 Aug 30 04:23:40.658925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 290/601] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:41.680142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:41.680715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:41.687675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.688161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.688598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.689305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.689757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.690184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.756101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:41.766214 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6cf6afd5-5fec-4064-946e-9e7197f2e4d6 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1290 microversion: 2.1 time: 0.090408 Aug 30 04:23:41.767197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 312/602] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:41 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:42.789344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:42.790144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:42.797181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.797718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.798153 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.798914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.799361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.800199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.004374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.012717 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2f009893-52a2-4eb9-9592-3caecb297eb4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.227450 Aug 30 04:23:43.013468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 291/603] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:42 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:43.070279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.070886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.077498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.078071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.078603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.079389 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.079902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.080386 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.162551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'services' on Instance uuid b08fcdf7-05cc-4789-981c-cb67b796f1bc {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:23:43.219607 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f09a45-d079-472f-9a0f-45714441aca5", "tag": "4b5eb000-c8f0-4513-96d5-77d22b2b35ca"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:43.230621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.231188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.231846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.240511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c6aeabbf-50c8-4eed-8823-88ffaaa47119 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments/731b95ab-c694-4a2b-9cb4-8e466897fdef" status: 202 len: 0 microversion: 2.1 time: 0.174313 Aug 30 04:23:43.241215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 313/604] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:23:43 2022] DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments/731b95ab-c694-4a2b-9cb4-8e466897fdef => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:43.247935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] Creating event network-changed:4b5eb000-c8f0-4513-96d5-77d22b2b35ca for instance a2f09a45-d079-472f-9a0f-45714441aca5 on hv-cinder-85220 Aug 30 04:23:43.253365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.255234 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-8c44af9f-1b2d-492d-be6e-dbcf6849af98 req-722956d9-d706-4987-b877-b15d4b7edbc7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042045 Aug 30 04:23:43.256570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 292/605] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:43.257356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.265124 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.266690 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.267241 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.268685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.269209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.269756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.303599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4d4a5042-10c5-44ad-bd73-0dfddd2217b9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056285 Aug 30 04:23:43.304171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 314/606] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:44.034286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.035604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:44.042161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.042672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.043098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.043774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.044213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.044625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.176636 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:44.184378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-77bd1c48-9989-478d-ae14-ecb051219fe3 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.154686 Aug 30 04:23:44.184937 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 293/607] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:44.316149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.318280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:44.324402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.324882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.325314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.325994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.326481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.326907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.357425 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-87846179-e764-4df9-aa5f-96442f73ca9f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Aug 30 04:23:44.357974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 315/608] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:45.205003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.205608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.212810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.213299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.213727 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.214459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.214901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.215316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.369375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.371483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.378022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.378547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.378990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.379734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.380183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.380604 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.408207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:45.412876 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7dbac31b-5827-49de-b398-508ebdf84863 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047818 Aug 30 04:23:45.413691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 316/609] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:23:45.426584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.434647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c8912730-39c4-48f5-8803-565014e539ff tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.233435 Aug 30 04:23:45.435539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 294/610] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:45.488863 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.489512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.499620 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.500194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.500648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.501340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.501783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.502485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.536214 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:45.619790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-df53f6cb-11f3-4ea2-8d0c-4d4fc26c2295 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 204 len: 0 microversion: 2.1 time: 0.133594 Aug 30 04:23:45.620374 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 317/611] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:45 2022] DELETE /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:23:45.628396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.629006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.636313 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.636797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.637230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.638511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.638987 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.639421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.771384 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.779184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a198c8da-5e2c-4ce7-8513-3115de2edea5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1688 microversion: 2.1 time: 0.154659 Aug 30 04:23:45.779756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 295/612] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:46.456652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.457368 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:46.464683 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.465156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.465582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.466291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.466744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.467156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.597459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.605960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5233fe29-35a7-47a8-9b70-cbef79f8f76b tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.153518 Aug 30 04:23:46.606557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 318/613] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:46.800730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.801314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:46.807957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.808442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.808877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.809580 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.810031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.810487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.937633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.945264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2c433f5-bb2d-4feb-bb73-e0158d3552d9 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1688 microversion: 2.1 time: 0.148555 Aug 30 04:23:46.945828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 296/614] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:47.627184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.627870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.634260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.635381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.635992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.636696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.637212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.637696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.782273 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:47.790000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ffcc5480-fb73-4b6c-b63b-a501d57d68c1 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.166912 Aug 30 04:23:47.790593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 319/615] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:47.966738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.967292 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.973695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.974175 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.974664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.975356 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.975810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.976231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.120631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.128632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-175e227f-2778-4693-b510-58bb6febdc12 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1688 microversion: 2.1 time: 0.166247 Aug 30 04:23:48.129217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 297/616] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:48.810837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.811525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:48.813948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:48.819229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.819713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.820149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.820841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.821291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.821709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.109168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:49.116702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-396fa221-ff7b-459a-ba7b-40b470b965ba tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.310139 Aug 30 04:23:49.117275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 320/617] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:49.149844 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:49.150484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:49.156939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.157418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.157849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.158561 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.159018 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.159440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.293913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:49.301680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ad41e128-8507-4a07-b489-9904d6caf28a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1688 microversion: 2.1 time: 0.155682 Aug 30 04:23:49.302280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 298/618] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:49 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:49.699066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f09a45-d079-472f-9a0f-45714441aca5", "name": "network-vif-plugged", "status": "completed", "tag": "4b5eb000-c8f0-4513-96d5-77d22b2b35ca"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:49.709439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.710156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.710848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.728142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] Creating event network-vif-plugged:4b5eb000-c8f0-4513-96d5-77d22b2b35ca for instance a2f09a45-d079-472f-9a0f-45714441aca5 on hv-cinder-85220 Aug 30 04:23:49.733239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-b0ab3ce4-8ff6-4bdb-838a-0078867ac8be req-a137f6f6-e1fa-48e8-bcf1-465bfcbfac52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038296 Aug 30 04:23:49.734092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 321/619] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:50.137793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.138428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.144854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.145338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.145763 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.146487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.146932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.147347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.324464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.326188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.334527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.335071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.335610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.337083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.337725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.338383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.380220 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.395211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-170a142b-8eda-4e1c-8032-e5e93c1030a4 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.261716 Aug 30 04:23:50.396422 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 299/620] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:50.408859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.418844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cb1c1f09-3f2b-4641-8ccc-ca937cf98f71 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1621 microversion: 2.1 time: 0.099524 Aug 30 04:23:50.421287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 322/621] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1621 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:50.427745 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08fcdf7-05cc-4789-981c-cb67b796f1bc", "name": "network-vif-deleted", "tag": "eb59a541-38aa-4db2-b9d0-47ff00f339c8"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:50.440550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.441333 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.441757 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.457975 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] Creating event network-vif-deleted:eb59a541-38aa-4db2-b9d0-47ff00f339c8 for instance b08fcdf7-05cc-4789-981c-cb67b796f1bc on hv-cinder-85220 Aug 30 04:23:50.463109 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-485c2a73-b034-4361-81bc-2b8ccf1f252a req-192fa49d-c029-4be0-a3d8-44e2523a43d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040034 Aug 30 04:23:50.463707 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 300/622] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:50.893083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-282909945"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:50.893774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.895996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:50.896873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=10 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:50.905013 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.906724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.907034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.907717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.908353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.908817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.063412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.network.security_group_api [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Removing security group 717ac52a-3f2f-4522-bdcd-7557eab93517 from port 7e166b02-3f14-40b4-b11a-1b65c4bce791 Aug 30 04:23:51.388726 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-08f39ecd-4005-43ba-a674-af7075743a41 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action" status: 202 len: 0 microversion: 2.1 time: 0.499996 Aug 30 04:23:51.390646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 323/623] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:50 2022] POST /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:51.397716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:51.404476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:51.417051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.417963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.418533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.421343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.422282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:51.430928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.431655 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.432288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.434348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] Creating event network-changed:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:23:51.434641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.435261 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.436077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.440685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-4eca6d17-53a6-4d0a-8158-fbc4b7debd5c req-3b0658f4-5ebd-4aa2-9254-0228910f8dd1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043968 Aug 30 04:23:51.443332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 301/624] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:51.450854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.451762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:51.459319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.460734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.461363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.462894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.463802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.465355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.512554 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.513040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.513478 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.513927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'fault' on Instance uuid b08fcdf7-05cc-4789-981c-cb67b796f1bc {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:23:51.636723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.661302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f16459e1-a5d0-40dc-9b56-854fb7e20b5f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 200 len: 1334 microversion: 2.1 time: 0.216551 Aug 30 04:23:51.669659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 302/625] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 1334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:51.735544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.759902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-680f8838-7201-44a0-bc97-d934ef425d13 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1364 microversion: 2.1 time: 0.343561 Aug 30 04:23:51.763239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 324/626] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:52.640176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.640831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.647284 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.647872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.648365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.649121 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.649632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.650128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.694103 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.694751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: b08fcdf7-05cc-4789-981c-cb67b796f1bc] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.701359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.701838 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.702279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.702974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.703420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.703845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.719070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] HTTP exception thrown: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Request method failure captured: Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc HTTP/1.1 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-3p5Xep934iUwstV6JMI33GcM9tIURT6ogzaAWeN5fk0Q5wgh518eMu_THo6zrtAvvhE_dKof3_P39EubOVwO19zOP-QfWiS5-N2d65ZFUuHk-ciiBUB8qQO4HQFeteyu83sL3yWom8ZXsFlRpxni7pXN5sPRWlsU0hzCY-3KXxuA Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:23:52.720702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: eb61948f41344ea481024a96cf03db37 Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. Aug 30 04:23:52.722336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'b08fcdf7-05cc-4789-981c-cb67b796f1bc'} Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:52.726390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. Aug 30 04:23:52.727848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:52.729193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Returning 404 to user: Instance b08fcdf7-05cc-4789-981c-cb67b796f1bc could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:52.729193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4a94c1fe-cb3f-4f80-b1a0-90491e941de3 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc" status: 404 len: 111 microversion: 2.1 time: 0.033572 Aug 30 04:23:52.729193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 325/627] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/b08fcdf7-05cc-4789-981c-cb67b796f1bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:52.730212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-16c149b0-e24e-4042-a606-fec19734fbbb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '.version_select at 0x7faa0d6e8550>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.750874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lazy-loading 'services' on Instance uuid 8a3a79d0-31a2-463a-b7db-749bfd7eb055 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:23:52.752622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-16c149b0-e24e-4042-a606-fec19734fbbb tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675997358" status: 202 len: 0 microversion: 2.1 time: 0.025810 Aug 30 04:23:52.753826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 326/628] 10.222.0.46 () {58 vars in 1218 bytes} [Tue Aug 30 04:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675997358 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:23:52.791221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.792553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.800340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.801079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.801668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.802787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.803389 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.803958 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.918560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-809246a6-781a-48bf-8828-831a86eeadbc tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments/a1c9d0c8-9780-4fa2-8258-bd432015b8b8" status: 202 len: 0 microversion: 2.1 time: 0.279950 Aug 30 04:23:52.919399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 303/629] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:23:52 2022] DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments/a1c9d0c8-9780-4fa2-8258-bd432015b8b8 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:52.930046 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.932881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.941638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.942101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.942575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.943275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.943718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.952920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.003825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:53.011888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cc79bfa0-efdd-4f13-ae13-79c9e1b0fa2a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1549 microversion: 2.1 time: 0.228812 Aug 30 04:23:53.013160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dde1bfe2-9d01-4873-af14-459f09333456 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088803 Aug 30 04:23:53.015137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 304/630] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:53.022811 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 327/631] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1549 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:53.038042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.039096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.049431 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.051076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.051746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.053161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.053988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.054659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.441503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-56de7725-df25-4995-80a2-7556207c2b42 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.407649 Aug 30 04:23:53.442104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 305/632] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:23:53 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-interface => generated 284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:53.535466 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:53.546497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.547248 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.548007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.563093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] Creating event network-changed:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:23:53.572679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-d518ac46-1cba-4ac5-a42e-4a46c6eaf197 req-93bdc44d-bb23-41f5-994f-03e4af787015 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041533 Aug 30 04:23:53.574922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 328/633] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:54.029442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.032721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.039849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.040526 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.041178 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.043941 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.044423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.044863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.077654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f2fb25a1-2012-42e8-a73d-57d6aca397dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053711 Aug 30 04:23:54.078842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 306/634] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:23:54.091673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.092345 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.100589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.101921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.102407 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.103119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.103996 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.105426 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.195070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] HTTP exception thrown: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 is not attached to volume a1c9d0c8-9780-4fa2-8258-bd432015b8b8 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Request method failure captured: Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments/a1c9d0c8-9780-4fa2-8258-bd432015b8b8 HTTP/1.1 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZAv0bHopTWuxyFxlB0FUM7_KXaKxWwZNaPx_LVG2pR5g3AHB2PGuD6UbJJQaH3C-bXgWtmsZbnHuI2Y7sl2CRci9mYlZmunc-u-ONc4SfEwVXCiXWApAo9P4sJnz2zWEpcqwOJmLMzbkymcs9y0UnZrV-Tt5BD8X8DSGOPs9OMGxHI Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: ddae968572774fa5b3d0a561b5c1b085 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:23:54.197451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: ddae968572774fa5b3d0a561b5c1b085 Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-TestMinimumBasicScenario-1493838071-project Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: cebdac97042f43ab9a900087d1ee6a3e Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-TestMinimumBasicScenario-1493838071-project Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:23:54.199686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 is not attached to volume a1c9d0c8-9780-4fa2-8258-bd432015b8b8 Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'server_id': '8a3a79d0-31a2-463a-b7db-749bfd7eb055', 'id': 'a1c9d0c8-9780-4fa2-8258-bd432015b8b8'} Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1c9d0c8-9780-4fa2-8258-bd432015b8b8. Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:54.200555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 is not attached to volume a1c9d0c8-9780-4fa2-8258-bd432015b8b8 Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 is not attached to volume a1c9d0c8-9780-4fa2-8258-bd432015b8b8 Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.201970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Returning 404 to user: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 is not attached to volume a1c9d0c8-9780-4fa2-8258-bd432015b8b8 {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:54.203177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e5d048d-9363-44df-810d-8508ccfc0558 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments/a1c9d0c8-9780-4fa2-8258-bd432015b8b8" status: 404 len: 154 microversion: 2.1 time: 0.114896 Aug 30 04:23:54.203177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 329/635] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:23:54 2022] DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055/os-volume_attachments/a1c9d0c8-9780-4fa2-8258-bd432015b8b8 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:54.865341 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f09a45-d079-472f-9a0f-45714441aca5", "tag": "4b5eb000-c8f0-4513-96d5-77d22b2b35ca"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:54.875089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.875569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.875997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.888037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] Creating event network-changed:4b5eb000-c8f0-4513-96d5-77d22b2b35ca for instance a2f09a45-d079-472f-9a0f-45714441aca5 on hv-cinder-85220 Aug 30 04:23:54.893256 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-f286fe09-311e-44a7-a7cc-c6cbc4b8e1e8 req-91f6b3a3-fd40-4db5-8484-38a75ff77122 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031336 Aug 30 04:23:54.893864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 307/636] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:55.348805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:55.349307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:55.356929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.357417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.358070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.358976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.359589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.360183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.387121 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:55.483262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-53f50951-1ee3-453b-b45a-207c672a2ffb tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 204 len: 0 microversion: 2.1 time: 0.137947 Aug 30 04:23:55.484111 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 330/637] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:55 2022] DELETE /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:55.492872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:55.494206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:55.502404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.502887 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.503310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.503999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.504438 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.505026 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.664021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:55.672402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fec1e1db-723e-49ef-aa2f-1ab2082b91dd tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1553 microversion: 2.1 time: 0.183869 Aug 30 04:23:55.672973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 308/638] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:55 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:56.150169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.150782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:56.156985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.157464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.157897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.158626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.159080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.159503 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.184752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:56.233087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:56.260410 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4be0d57-68d3-442f-acf0-688ad8f15511 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 204 len: 0 microversion: 2.1 time: 0.114190 Aug 30 04:23:56.261698 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 331/639] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:56 2022] DELETE /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:56.269985 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.270634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:56.277009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.277489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.277912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.278811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.279263 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.279682 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.283899 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:56.412363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:56.420532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c23b194d-e3f6-4bb0-8dc4-21084acffda4 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1508 microversion: 2.1 time: 0.154688 Aug 30 04:23:56.421097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 309/640] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:56 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:56.695015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.695735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:56.702476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.702947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.703374 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.704049 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.704490 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.704900 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.834694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:56.843313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8a10b77-da3e-4202-b996-c1777fc5550f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1553 microversion: 2.1 time: 0.153266 Aug 30 04:23:56.843888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 332/641] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:56 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:57.441848 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:57.442481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:57.449508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:57.449983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:57.450446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:57.451132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:57.451581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:57.452001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:57.578846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:57.586469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-85e8e7cd-c4be-44ab-86b5-511d72712c1b tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1508 microversion: 2.1 time: 0.148427 Aug 30 04:23:57.587038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 310/642] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:57 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:57.864155 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:57.864884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:57.871837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:57.872303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:57.872724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:57.873397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:57.873836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:57.874266 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.003776 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.011709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-154f4621-7f0c-4ccd-ba54-fb7526421898 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1553 microversion: 2.1 time: 0.151431 Aug 30 04:23:58.012282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 333/643] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:57 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:58.608098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:58.608712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:58.615402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.615881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.616320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.617008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.617456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.617875 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.750888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.758414 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-65a8251b-c83a-4cbb-9a6e-9b28aee305a0 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1508 microversion: 2.1 time: 0.154862 Aug 30 04:23:58.758974 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 311/644] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:58 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:59.033436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:59.034039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:59.040518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.040992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.041421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.042230 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.042704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.043126 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.177892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:59.185974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-636d63fe-7a25-49e0-864c-c5a40baaa8b2 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1553 microversion: 2.1 time: 0.156432 Aug 30 04:23:59.186592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 334/645] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:59 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:59.780709 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:59.781316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:59.789267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.789869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.791056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.792023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.793035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.793589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.015237 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a79d0-31a2-463a-b7db-749bfd7eb055", "name": "network-vif-deleted", "tag": "7e166b02-3f14-40b4-b11a-1b65c4bce791"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:00.025070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:00.025541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:00.025967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.037359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] Creating event network-vif-deleted:7e166b02-3f14-40b4-b11a-1b65c4bce791 for instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 on hv-cinder-85220 Aug 30 04:24:00.042314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-c6dde6ff-9550-48e4-a777-ef24eb95ffd0 req-c5358c40-668d-440f-b575-832d6a8728e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031733 Aug 30 04:24:00.043023 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 335/646] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:00.089509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:00.097208 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-88cdee76-6a4c-429c-b89a-5c36bf136b0f tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1508 microversion: 2.1 time: 0.321066 Aug 30 04:24:00.097796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 312/647] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:59 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:00.215660 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:00.216367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:00.223531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:00.224306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:00.224736 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.225619 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:00.226153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:00.226614 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.313563 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebdac97042f43ab9a900087d1ee6a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddae968572774fa5b3d0a561b5c1b085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:00.327130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b5f7f13f-3b71-44f7-90be-c616cf174e8e tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 200 len: 1342 microversion: 2.1 time: 0.118686 Aug 30 04:24:00.342116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 336/648] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:00 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 1342 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:01.120501 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:01.121169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:01.129553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.130025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.130484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.131167 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.131608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.132102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.172543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.173031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.173469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.173929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lazy-loading 'fault' on Instance uuid 67620860-4433-443f-9ed6-f67a98bf44cf {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:24:01.215877 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:01.223652 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0f6e9b4c-0e87-473b-97c6-4338dded18a8 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 200 len: 1312 microversion: 2.1 time: 0.109097 Aug 30 04:24:01.224226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 313/649] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:01 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:01.348853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:01.349436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] [instance: 8a3a79d0-31a2-463a-b7db-749bfd7eb055] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:01.356629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.357093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.357580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.358306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.358730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.359139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.372247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] HTTP exception thrown: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Request method failure captured: Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 HTTP/1.1 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZAv0bHopTWuxyFxlB0FUM7_KXaKxWwZNaPx_LVG2pR5g3AHB2PGuD6UbJJQaH3C-bXgWtmsZbnHuI2Y7sl2CRci9mYlZmunc-u-ONc4SfEwVXCiXWApAo9P4sJnz2zWEpcqwOJmLMzbkymcs9y0UnZrV-Tt5BD8X8DSGOPs9OMGxHI Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: ddae968572774fa5b3d0a561b5c1b085 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:24:01.373778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ddae968572774fa5b3d0a561b5c1b085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: ddae968572774fa5b3d0a561b5c1b085 Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1493838071 Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-TestMinimumBasicScenario-1493838071-project Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: cebdac97042f43ab9a900087d1ee6a3e Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-TestMinimumBasicScenario-1493838071-project Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. Aug 30 04:24:01.375430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '8a3a79d0-31a2-463a-b7db-749bfd7eb055'} Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:01.376362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. Aug 30 04:24:01.377772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:01.379132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Returning 404 to user: Instance 8a3a79d0-31a2-463a-b7db-749bfd7eb055 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:01.379132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fe73136d-eeae-405a-b95c-46a1450eb478 tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055" status: 404 len: 111 microversion: 2.1 time: 0.030434 Aug 30 04:24:01.379132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 337/650] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:01 2022] GET /compute/v2.1/servers/8a3a79d0-31a2-463a-b7db-749bfd7eb055 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:01.383889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-de280c77-4342-4ab2-b9a3-99838131e79f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] Calling method '.version_select at 0x7faa0d5921f0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:01.403273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-de280c77-4342-4ab2-b9a3-99838131e79f tempest-TestMinimumBasicScenario-1493838071 tempest-TestMinimumBasicScenario-1493838071-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118234452" status: 202 len: 0 microversion: 2.1 time: 0.022200 Aug 30 04:24:01.403922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 314/651] 10.222.0.46 () {58 vars in 1269 bytes} [Tue Aug 30 04:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118234452 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:24:02.056970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67620860-4433-443f-9ed6-f67a98bf44cf", "name": "network-vif-deleted", "tag": "84574c99-3886-4ef8-b113-d17a2f4ac835"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:02.067302 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.067776 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.068203 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.079972 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] Creating event network-vif-deleted:84574c99-3886-4ef8-b113-d17a2f4ac835 for instance 67620860-4433-443f-9ed6-f67a98bf44cf on hv-cinder-85220 Aug 30 04:24:02.084758 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-d8c26537-fda1-4e10-9c99-18c0bea2f1bf req-1cebc0b1-451d-4074-9e77-639ca61a9355 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031419 Aug 30 04:24:02.085432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 338/652] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:02.245546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.248146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 67620860-4433-443f-9ed6-f67a98bf44cf] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:02.250021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:02.256368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.256852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.257279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.258016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.258477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.258892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.276405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] HTTP exception thrown: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Request method failure captured: Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf HTTP/1.1 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-3p5Xep934iUwstV6JMI33GcM9tIURT6ogzaAWeN5fk0Q5wgh518eMu_THo6zrtAvvhE_dKof3_P39EubOVwO19zOP-QfWiS5-N2d65ZFUuHk-ciiBUB8qQO4HQFeteyu83sL3yWom8ZXsFlRpxni7pXN5sPRWlsU0hzCY-3KXxuA Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:24:02.278059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: eb61948f41344ea481024a96cf03db37 Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. Aug 30 04:24:02.279647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '67620860-4433-443f-9ed6-f67a98bf44cf'} Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:02.280449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. Aug 30 04:24:02.281632 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:02.282742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Returning 404 to user: Instance 67620860-4433-443f-9ed6-f67a98bf44cf could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:02.282742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d79dd58b-a01d-468f-ab80-c0db95af8ad6 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf" status: 404 len: 111 microversion: 2.1 time: 0.038452 Aug 30 04:24:02.282742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 315/653] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1/servers/67620860-4433-443f-9ed6-f67a98bf44cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:02.288791 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.289370 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:02.296002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.296488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.296918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.297614 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.298156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.298639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.327809 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:24:02.409732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8efb89bb-4ef0-492d-8993-b1f6a9519289 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 204 len: 0 microversion: 2.1 time: 0.124839 Aug 30 04:24:02.410670 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 339/654] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:24:02 2022] DELETE /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:24:02.419698 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.420311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:02.426473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.426953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.427392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.428081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.428535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.428953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.561341 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:02.569131 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-818b431b-bcc6-4eed-b267-d8259989efe1 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.153865 Aug 30 04:24:02.569702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 316/655] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:03.665114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:03.666220 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:03.672884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:03.673599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:03.674235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:03.675132 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:03.676110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:03.676690 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:03.823676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:03.832901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b893a56a-6354-4799-9e0f-fce8d4c44769 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.247099 Aug 30 04:24:03.833479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 340/656] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:03 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:04.858212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:04.860519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:04.869934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.870563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.871538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:04.873170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.873731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.875232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:05.131175 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:05.145371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4c36313f-c68b-4ce6-99fd-11923eed6e43 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.294462 Aug 30 04:24:05.147177 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 317/657] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:04 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:06.168915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:06.169686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:06.176525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.177136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.177676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.178492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.179172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.179687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.403720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61948f41344ea481024a96cf03db37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a5c650ed23445bb585711f962d7e09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:06.412215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1e72eec4-a3df-4c73-9e21-0a5789f23ee5 tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 200 len: 1522 microversion: 2.1 time: 0.248357 Aug 30 04:24:06.413218 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 341/658] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:06 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:06.591832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fde664c-f504-436a-bc03-41126ce28efe", "name": "network-vif-deleted", "tag": "df23e2a1-bcf8-455e-aa83-acb143334ab7"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:06.608423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.608988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.609489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.622522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] Creating event network-vif-deleted:df23e2a1-bcf8-455e-aa83-acb143334ab7 for instance 5fde664c-f504-436a-bc03-41126ce28efe on hv-cinder-85220 Aug 30 04:24:06.627956 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-5e130e97-c2ec-4c2d-9296-5affbe8d65a2 req-033eb37e-f698-4cf2-979f-73fbfb0d189e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Aug 30 04:24:06.628591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 318/659] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:07.433138 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:07.434802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] [instance: 5fde664c-f504-436a-bc03-41126ce28efe] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:07.441560 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:07.442094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:07.442658 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:07.444265 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:07.444841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:07.445785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:07.463925 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] HTTP exception thrown: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Request method failure captured: Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe HTTP/1.1 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-3p5Xep934iUwstV6JMI33GcM9tIURT6ogzaAWeN5fk0Q5wgh518eMu_THo6zrtAvvhE_dKof3_P39EubOVwO19zOP-QfWiS5-N2d65ZFUuHk-ciiBUB8qQO4HQFeteyu83sL3yWom8ZXsFlRpxni7pXN5sPRWlsU0hzCY-3KXxuA Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:24:07.466341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9a5c650ed23445bb585711f962d7e09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: a9a5c650ed23445bb585711f962d7e09 Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1317422711 Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: eb61948f41344ea481024a96cf03db37 Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1317422711-project Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. Aug 30 04:24:07.468033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '5fde664c-f504-436a-bc03-41126ce28efe'} Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:07.468976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. Aug 30 04:24:07.470543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:24:07.472716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] Returning 404 to user: Instance 5fde664c-f504-436a-bc03-41126ce28efe could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:07.473974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-53164c86-6481-4dce-b9bd-7c33c021189a tempest-ServerRescueNegativeTestJSON-1317422711 tempest-ServerRescueNegativeTestJSON-1317422711-project] 10.222.0.46 "GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe" status: 404 len: 111 microversion: 2.1 time: 0.044795 Aug 30 04:24:07.478069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 342/660] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:07 2022] GET /compute/v2.1/servers/5fde664c-f504-436a-bc03-41126ce28efe => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:15.923698 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.924274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:15.931793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.932295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.932895 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.934696 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.935360 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.935948 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.968697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0b8261cc-63a0-4f3b-947f-701851a259fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/ips" status: 200 len: 153 microversion: 2.20 time: 0.508544 Aug 30 04:24:15.969659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 319/661] 10.222.0.46 () {60 vars in 1289 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/ips => generated 153 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:24:18.801047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:18.801618 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:18.807855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:18.809659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=58,nova_cell1:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:18.811901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:18.812457 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:18.813376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:18.816725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:18.817231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:18.817659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:18.859693 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lazy-loading 'flavor' on Instance uuid 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:24:19.240400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d41833f8-19db-49cd-a4ad-defe6775c733 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/action" status: 202 len: 0 microversion: 2.20 time: 0.445864 Aug 30 04:24:19.241679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 343/662] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 30 04:24:18 2022] POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:24:19.259050 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:19.260523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:19.269575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:19.282521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:19.285362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:19.286421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:19.288498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:19.289762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:19.547271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e262a9cd-d825-4938-a21e-6ee3748a4862 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: .version_select at 0x7faa0d596c10>, body: {"keypair": {"name": "tempest-keypair-79509982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFD059fu9G8ykNa8Bd+MX4xcr6FSupga38TQuWJQ/R30IPahr7uquQuVn0afx2n97PB6+7kyVsf0meGPdSAA60oWRaXVYU+u64vEDkkfucOMz9gPCdls+V0NX+C20PNwQ=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:19.580280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:19.581700 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-e262a9cd-d825-4938-a21e-6ee3748a4862 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:19.585761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-e262a9cd-d825-4938-a21e-6ee3748a4862 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:19.594306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:19.596425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:19.598039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-95a003d2-8db7-4ba5-888a-6572e0bea5e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.350578 Aug 30 04:24:19.622060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 320/663] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:19 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:19.630719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e262a9cd-d825-4938-a21e-6ee3748a4862 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.371619 Aug 30 04:24:19.631483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 344/664] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:24:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:20.626420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:20.627038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:20.642968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.644466 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.645141 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.648387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.652034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.653542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:21.083096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:21.097864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:21.099784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:21.101387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eafdb6c5-c909-4934-b320-b0a91a7024cf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.479147 Aug 30 04:24:21.102607 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 321/665] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:20 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:22.126608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:22.128367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:22.135970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:22.136809 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:22.137686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:22.139185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:22.139879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:22.140531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:22.335885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:22.348283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:22.350583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:22.352018 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2ff0b10d-969c-435d-959f-b088ef7e2b58 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.230648 Aug 30 04:24:22.353446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 345/666] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:22 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:22.390289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-245269383", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2144ee9-7e1a-4a81-ac65-28f49d99b870"}], "security_groups": [{"name": "tempest-securitygroup--670964524"}], "key_name": "tempest-keypair-79509982", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:22.547955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] validate_networks() for [('e2144ee9-7e1a-4a81-ac65-28f49d99b870', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:24:23.379082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:23.382579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:23.393235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.394034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.394694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.395672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.396354 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.398798 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.439326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:24:23.439795 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:24:23.440933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:24:23.441552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:24:23.448418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:24:23.474477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.477912 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.481569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.484782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.487919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.488651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.539032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:23.550454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:23.578852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:24:23.581705 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:24:23.663503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a4dd8dfd-edb1-4fcb-8e60-ad2a5bef9a56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.277529 Aug 30 04:24:23.664266 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 322/667] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:24:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:24:23.679211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eef3c5e7-a253-41ee-a096-d5e9ff5c6d52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:23.680132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eef3c5e7-a253-41ee-a096-d5e9ff5c6d52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:23.687198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:23.713154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:23.725616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:23.731773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9ec1c300-fd7b-4229-8dda-e0bca82355d5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.357132 Aug 30 04:24:23.735709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 346/668] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:23 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:23.804664 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-eef3c5e7-a253-41ee-a096-d5e9ff5c6d52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:23.812111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eef3c5e7-a253-41ee-a096-d5e9ff5c6d52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1239 microversion: 2.1 time: 0.137999 Aug 30 04:24:23.813203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 323/669] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:23 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1239 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:24.440635 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b5a0637a-486a-4c8f-8888-09f9c1aed72e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Action: 'create', calling method: .version_select at 0x7faa0d5da790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1393245950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo16XCRjc6BGIwW/UCINGKsjyuJdEAwyp4LHS4SDzI6PCclod7Bh4T5A1ph4WF//Wk+fpwE5/6Gpule/NcVO5kzVvaUIktzW/clLdcJxn5Gv3oWWSJcVcv7t+/RXFc0aA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:24.458141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-b5a0637a-486a-4c8f-8888-09f9c1aed72e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Getting quotas for project b0f04feca7a349e5a656f166dae05354. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:24.462731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-b5a0637a-486a-4c8f-8888-09f9c1aed72e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Getting quotas for user 7ba21f12574c4b9281d090651174788a and project b0f04feca7a349e5a656f166dae05354. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:24.489041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b5a0637a-486a-4c8f-8888-09f9c1aed72e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.313257 Aug 30 04:24:24.490078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 347/670] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:24:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:24.761909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.762864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:24.779122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.779425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.780299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:24.781408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.783516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.784304 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:24.833836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.835323 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:24.858008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.859135 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.860524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:24.862183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.863751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.864538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:24.988234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:24.998676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4f1e2345-b467-4c6d-9cb0-e52de8f60816 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1291 microversion: 2.1 time: 0.169311 Aug 30 04:24:25.012039 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 348/671] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:24 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1291 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:25.045966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:25.057224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:25.060077 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:25.061369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4145ed2c-e9c1-47e9-85a5-f10ebde60c0c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.304396 Aug 30 04:24:25.062049 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 324/672] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:24 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:26.023122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:26.023743 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:26.031609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.032280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.033114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:26.033990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.034633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.035220 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:26.085711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:26.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:26.100189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.102596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.104603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:26.107304 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.107794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.108303 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:26.129703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:26.142128 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-eb826b8e-c8a0-485d-96bd-d08d1acf35fe tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1297 microversion: 2.1 time: 0.122662 Aug 30 04:24:26.158802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 349/673] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:26 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:26.414870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:26.417300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=75 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:26.433104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:26.437183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:26.442948 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f9beb392-5482-4b5c-943a-24869c8c701e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.357743 Aug 30 04:24:26.446970 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 325/674] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:26 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:27.166453 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.167152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:27.179465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.180470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.181097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.181711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.185778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.186385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.473055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.474456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:27.483703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.484200 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.484631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.493071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.493766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.495287 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.593849 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:27.604754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-47b95bf1-0da5-4ee0-a655-cda1396cb205 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.442845 Aug 30 04:24:27.606133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 350/675] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:27.750098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:27.766715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:27.770811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:27.773448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-90e159e4-3560-4e6e-93b9-6512b8b60ac0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.303551 Aug 30 04:24:27.774886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 326/676] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:27.795534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711629d5-ba60-4bfd-a61e-7a06e25db924", "tag": "d8e07c04-5a1e-4b74-8720-2de48fec19b7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:27.819785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.821489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.821941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.837892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] Creating event network-changed:d8e07c04-5a1e-4b74-8720-2de48fec19b7 for instance 711629d5-ba60-4bfd-a61e-7a06e25db924 on hv-cinder-85220 Aug 30 04:24:27.843765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-387d41e6-c882-491f-9d43-17f9b7c7c587 req-0f3bf2f6-48e9-4c13-80e4-65ff7275c43f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055562 Aug 30 04:24:27.844757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 351/677] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:28.626657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:28.627278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:28.637012 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.637956 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.638469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.639310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.639785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.640211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.778754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:28.787388 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e7d8f67-f013-47ac-a662-b351f9fa4061 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.164441 Aug 30 04:24:28.792627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 327/678] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:28 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:28.804035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:28.804833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:28.816871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.817661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.818133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.818955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.819485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.819821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.958646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:28.967555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:28.969001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:28.970167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2620bc96-7653-45ab-8965-7f23d2f12c7a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.170449 Aug 30 04:24:28.970747 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 352/679] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:28 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:29.810151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:29.811309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:29.827696 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.828186 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.828614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.829511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.829954 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.830397 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.993098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:29.994559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:29.996899 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:30.003191 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:30.003702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:30.004373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:30.005271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:30.005924 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:30.006603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:30.006818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aec96cbd-ffc3-4c20-bf8d-bc80a80bea58 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.201421 Aug 30 04:24:30.007489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 328/680] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:29 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:30.182045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:30.191819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:30.194775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:30.196228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b016946b-a8ac-4c78-ab04-74df42e70f28 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.206937 Aug 30 04:24:30.197089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 353/681] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:29 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:31.030619 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:31.031244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:31.037529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.038001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.038463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.039140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.039618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.040031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.166758 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:31.167296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:31.174803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.175292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.175728 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.176436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.176890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.177317 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.187449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:31.195306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-7c97c506-2e47-4f13-9ed5-e7088feebc13 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.168541 Aug 30 04:24:31.196098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 329/682] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:31.202723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fc89c448-707a-4bf0-ab63-b16078a02d33 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/ips" status: 200 len: 145 microversion: 2.1 time: 0.153272 Aug 30 04:24:31.203468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 354/683] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/ips => generated 145 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:31.221133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:31.221922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:31.232734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.233209 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.233634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.234382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.234879 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.235428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.407782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:31.417432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:31.420032 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:31.421417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2d27f884-b705-4697-b5ea-e7a728cc37aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.205343 Aug 30 04:24:31.424173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 330/684] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:31.972405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711629d5-ba60-4bfd-a61e-7a06e25db924", "name": "network-vif-plugged", "status": "completed", "tag": "d8e07c04-5a1e-4b74-8720-2de48fec19b7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:31.983672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.984129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.984532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.997402 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] Creating event network-vif-plugged:d8e07c04-5a1e-4b74-8720-2de48fec19b7 for instance 711629d5-ba60-4bfd-a61e-7a06e25db924 on hv-cinder-85220 Aug 30 04:24:32.002150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-0308a4d9-23cf-44f4-9596-17f89fa2cdec req-4164a8a9-0e6d-4fb4-bcae-ae181adc7eb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Aug 30 04:24:32.002974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 355/685] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:32.217266 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.217853 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.224219 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.224701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.225132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.225824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.226291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.226721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.366703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:32.375094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-65d238e3-83d8-425b-8004-2f6b194ddfa0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.162451 Aug 30 04:24:32.375669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 331/686] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:32 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:32.449309 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.450056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.456184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.456667 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.457097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.457816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.458276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.458697 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.578821 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd84cbd7-1bda-4817-aecc-2198b19ad64c"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:32.581161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.583047 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:32.588625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.589125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.590077 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.590823 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.591265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.591686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.594164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:32.603745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:32.605254 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:32.606580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5f79c134-696e-46ac-b205-3d740971cec3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.162562 Aug 30 04:24:32.607190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 356/687] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:32 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:33.152013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6e7e9cfe-25d7-4579-a4cf-323c9c4c9f24 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577912 Aug 30 04:24:33.152840 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 332/688] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:24:32 2022] POST /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:33.396650 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:33.397184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:33.403432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.403940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.404384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.405054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.405502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.405920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.541928 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.550499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6d511e23-6190-401d-a15e-e713a679dc8a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1364 microversion: 2.1 time: 0.158044 Aug 30 04:24:33.551149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 357/689] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:33 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:33.630615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:33.631298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:33.633687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:33.640089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.640575 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.641038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.641760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.642210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.642940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.781511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.789666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.791123 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.792289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83269a4f-4589-4913-8491-27205efb0ef8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.165960 Aug 30 04:24:33.792851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 333/690] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:33 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:34.571788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.572340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:34.575933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=8 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:34.581940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.582461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.582901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.583607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.584057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.584481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.721759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:34.729871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a8a47001-dc46-4dc1-84d8-c4fdce16899e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1553 microversion: 2.1 time: 0.162128 Aug 30 04:24:34.731067 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 358/691] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:34 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:34.752019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.752591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:34.754372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=8 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:34.760145 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.760624 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.761057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.762105 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.762639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.763067 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.814950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.815557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:34.822115 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.822577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.823012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.824232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.824793 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.825219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.845140 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5f970288-2c6d-4556-a58c-f3c073fa2f04 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097082 Aug 30 04:24:34.845951 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 334/692] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:24:34 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:35.095491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:35.103661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:35.105821 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:35.107196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7fc5283a-5739-4e04-ac49-7db405a72277 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.296161 Aug 30 04:24:35.107756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 359/693] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:34 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:35.980896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711629d5-ba60-4bfd-a61e-7a06e25db924", "tag": "d8e07c04-5a1e-4b74-8720-2de48fec19b7"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:35.990634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:35.991227 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:35.991521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.003202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] Creating event network-changed:d8e07c04-5a1e-4b74-8720-2de48fec19b7 for instance 711629d5-ba60-4bfd-a61e-7a06e25db924 on hv-cinder-85220 Aug 30 04:24:36.008469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-92e9bf8a-2b0d-493d-bb8e-6212b571cef5 req-1f80a131-176f-4b61-80b0-1e3559ef0dfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093524 Aug 30 04:24:36.009265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 335/694] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:36.131289 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:36.131933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:36.141095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.141756 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.142057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.143287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.143923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.144827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.314754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:36.323378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:36.325752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:36.327008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fa104fc8-3f41-4b69-b1d8-49e42bde6601 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.199700 Aug 30 04:24:36.327755 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 360/695] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:36 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:37.353096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:37.354136 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:37.361808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:37.362310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:37.362743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:37.363553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:37.364230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:37.364862 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:37.507507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:37.516232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:37.517647 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:37.519072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-357c2f6f-f6e1-41a6-80b2-35ac51147441 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.171254 Aug 30 04:24:37.519627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 336/696] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:37 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:38.540921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:38.541522 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:38.548170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:38.548650 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:38.549845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:38.549845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:38.550199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:38.550639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:38.554907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:38.688142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:38.700451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:38.703055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:38.705062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-79e7474f-59fd-438d-b3cc-33291deabeec tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.167788 Aug 30 04:24:38.705959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 361/697] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:38 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:39.733024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:39.733700 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:39.741398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.741886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.742348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.743052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.743502 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.743921 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.882138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:39.891938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:39.893910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:39.895098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b9265e6e-12b8-4c9b-948a-c50eae7180d7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.166487 Aug 30 04:24:39.895652 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 337/698] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:39 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:40.741880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.744140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:40.751226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.751706 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.752136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.752819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.753272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.753739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.783138 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-cf6ad5da-e1f0-4d32-8f08-4a9016957953 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Aug 30 04:24:40.783693 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 362/699] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:40 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:40.795132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.795631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:40.802035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.802549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.802987 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.803672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.804123 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.804541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.837481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a0253ce9-bf48-4d52-afcc-b6cadc94fc9a tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c" status: 200 len: 194 microversion: 2.1 time: 0.047185 Aug 30 04:24:40.838073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 338/700] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 30 04:24:40 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:40.918279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.919579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:40.925799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.926304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.926784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.927585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.928134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.928542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.084586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:41.093943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:41.095510 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:41.096882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4ebaeda2-4e4d-439e-9f3e-265cd8928471 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1746 microversion: 2.20 time: 0.183611 Aug 30 04:24:41.097767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 363/701] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:40 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:41.297742 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-682824036", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1393245950", "security_groups": [{"name": "tempest-secgroup-smoke-1764004668"}], "networks": [{"uuid": "d7d92f54-c849-4928-94b8-15ca960aef5a"}], "block_device_mapping_v2": [{"uuid": "115dfd64-24b0-4581-961e-ee179cd1630e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:41.414277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] validate_networks() for [('d7d92f54-c849-4928-94b8-15ca960aef5a', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:24:41.786242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:24:41.786703 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:24:41.787308 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:24:41.787710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:24:41.788107 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:24:41.798194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.798927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.799277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.800174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.800772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.800904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.820099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Getting quotas for project b0f04feca7a349e5a656f166dae05354. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:41.824975 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Getting quotas for user 7ba21f12574c4b9281d090651174788a and project b0f04feca7a349e5a656f166dae05354. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:41.882420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:24:41.884543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='115dfd64-24b0-4581-961e-ee179cd1630e',volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:24:42.030488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9694ad5a-9e55-47c8-bd16-f752b37b1727 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736446 Aug 30 04:24:42.031142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 339/702] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:24:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:24:42.042279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac8ff800-1143-4078-ba4b-52e38ae027be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:42.044299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac8ff800-1143-4078-ba4b-52e38ae027be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:42.111614 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac8ff800-1143-4078-ba4b-52e38ae027be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:42.119073 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac8ff800-1143-4078-ba4b-52e38ae027be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1088 microversion: 2.1 time: 0.081133 Aug 30 04:24:42.121082 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:42.122156 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:42.129386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.130706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.131417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.133004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 364/703] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:42 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:42.137584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.142628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.143813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.203413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52a6871-ab87-4c71-bcad-a2ded47f07aa"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:42.206355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:42.213847 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.215349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.215951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.216819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.217264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.217835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.305847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:42.316097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:42.318540 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:42.320447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8e57191a-ce8c-434e-b503-41862bea966e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1746 microversion: 2.20 time: 0.203470 Aug 30 04:24:42.321512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 340/704] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:42 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1746 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:42.487861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d757abfc-4cc3-4e90-97d7-bf55249429c0 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "POST /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290579 Aug 30 04:24:42.488625 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 365/705] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:24:42 2022] POST /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:43.139706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:43.140316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:43.147096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.147570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.148000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.148686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.149133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.149553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.211309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:43.219793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a97e40b5-7654-4bdf-91e8-a1bb451b08d0 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1186 microversion: 2.1 time: 0.084338 Aug 30 04:24:43.220370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 341/706] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:43 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:43.351011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:43.351698 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:43.362662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.363470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.364274 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.365207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.366117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.366664 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.513474 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:43.523234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:43.524679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:43.525847 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e27b3321-5334-4ace-9392-583f63715d9e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.179482 Aug 30 04:24:43.526588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 366/707] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:43 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:44.139802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "name": "network-vif-plugged", "status": "completed", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:44.162511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.163232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.163863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.193287 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] Creating event network-vif-plugged:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:24:44.207378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-a843a448-0896-4669-b49d-23faf53c427c req-45e7c415-7d96-428c-8a70-d7f946f865ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197432 Aug 30 04:24:44.212979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 342/708] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:44.241742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:44.242380 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:44.253736 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.254942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.256417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.261352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.262143 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.262769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.457932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.467687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2a79d479-5388-4756-b8ff-12ab49ab4639 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1272 microversion: 2.1 time: 0.230012 Aug 30 04:24:44.468605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 367/709] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:44 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:44.554179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:44.554903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:44.565050 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.565791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.566419 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.567472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:44.568081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:44.568670 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.586845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:44.810559 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.819137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.825170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.828169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9dc5c88f-2ea8-4031-a7b2-9d789a4978f6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.280216 Aug 30 04:24:44.831008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 343/710] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:44 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:45.292209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:45.304192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.305168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.305784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.323358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] Creating event network-changed:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:24:45.329903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-6c75cb80-c7e3-44ea-abc0-787dc8183b24 req-045cd219-d24a-4dd5-9237-38a8a125143a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150337 Aug 30 04:24:45.331086 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 368/711] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:45.498017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.499479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:45.513787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.514630 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.515303 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.516187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.516798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.518304 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.799905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:45.814372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d2bce1d0-7abb-4038-a5f2-4293b22a8a55 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1272 microversion: 2.1 time: 0.321120 Aug 30 04:24:45.815906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 344/712] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:45.853807 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.855608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:45.869300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.871321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.872026 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.874649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.875204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.876190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:46.091463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:46.100696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:46.103967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:46.106325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6694c4a0-3a5b-4257-9256-bc8b14ed74e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.256891 Aug 30 04:24:46.107532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 369/713] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:46.838613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:46.838613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:46.845244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:46.846044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:46.846521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:46.847224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:46.847678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:46.848238 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.037777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.047310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1dc1aca6-e60c-4b88-a36f-74e5e182bfb8 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1272 microversion: 2.1 time: 0.214708 Aug 30 04:24:47.048469 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 345/714] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:46 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:47.135792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:47.137616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:47.146343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.146999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.147813 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.148541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.149227 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.149656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.297444 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.306551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.308063 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.309279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-503fa569-2a29-4686-b3ba-1c00ac452a6f tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.177690 Aug 30 04:24:47.309846 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 370/715] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:47 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:48.069036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:48.070331 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:48.084083 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.084593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.085026 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.085724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.086174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.086615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.252113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:48.261017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ef48bcb6-9335-414a-a00a-1773f5fc0136 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1272 microversion: 2.1 time: 0.195883 Aug 30 04:24:48.263205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 346/716] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:48 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:48.334150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:48.335209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:48.345910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.346939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.347588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.349817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.350896 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.351558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.500730 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:48.512473 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:48.514225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:48.515457 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-694d38b2-6db1-4041-806d-e9100ff9c56a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.186757 Aug 30 04:24:48.516049 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 371/717] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:48 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:49.283108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:49.284541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:49.293016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.293786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.294501 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.295457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.295914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.296338 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.473476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.482606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5b9e100b-3b22-4f6e-b5a8-c5373ecd5172 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1272 microversion: 2.1 time: 0.203399 Aug 30 04:24:49.492836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 347/718] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:49 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:49.540028 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:49.540612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:49.543988 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:49.549222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.549786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.550539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.551353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.551811 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.552236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.702735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.711364 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.713181 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.714654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7ffd3279-c199-4029-a21c-1b517c1d0802 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.178557 Aug 30 04:24:49.715278 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 372/719] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:49 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:50.186536 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.189162 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.195962 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.196785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.198058 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.199481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.200146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.200773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.245777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5b9667d1-f553-4808-ba83-1574246a6118 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064422 Aug 30 04:24:50.246552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 348/720] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:50.361808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.363305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.373822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.374783 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.375779 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.377033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.377845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.378792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.433142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4bbd8387-c206-414f-9cc8-c2ac6afd0263 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c" status: 200 len: 194 microversion: 2.1 time: 0.079021 Aug 30 04:24:50.434386 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 373/721] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:50.448264 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.449966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.459847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.460619 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.461324 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.462428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.463133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.463812 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.506468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.507464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.517424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.518769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.519481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.520576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.521252 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.522016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.586978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lazy-loading 'services' on Instance uuid a2f09a45-d079-472f-9a0f-45714441aca5 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:24:50.708622 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-73c37637-1d4d-4407-a377-a29075633638 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c" status: 202 len: 0 microversion: 2.1 time: 0.267610 Aug 30 04:24:50.727392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 349/722] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:24:50 2022] DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/bd84cbd7-1bda-4817-aecc-2198b19ad64c => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:24:50.743374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.744371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.754182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.759507 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.760493 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.763576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.764718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.765202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-45eac473-a2a0-4c43-8b5f-cb6c7c5ac5d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.265061 Aug 30 04:24:50.765365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.765752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.766471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 374/723] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:50.945919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.959935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.963463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.966864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-367b6e5f-c0de-4e19-a7b6-d4bb55aef54e tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.232272 Aug 30 04:24:50.968245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 350/724] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:51.788223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.789530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:51.797363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.797954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.799545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.800770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.801638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.802355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.970897 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.972525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:51.978008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:51.979007 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:51.983487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.984050 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.984902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.987295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.987295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.987295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.989657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:51.999859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2c1b0e70-a671-4d44-9c23-b1fcd19e0447 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.215540 Aug 30 04:24:52.001195 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 375/725] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:51 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:52.005868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:52.006581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:52.013830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.018843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.021219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.022273 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.022991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.023636 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.042193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5c1f9118-00f7-417a-8b80-4606efca901f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/d52a6871-ab87-4c71-bcad-a2ded47f07aa" status: 200 len: 194 microversion: 2.1 time: 0.075271 Aug 30 04:24:52.049224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 351/726] 10.222.0.46 () {58 vars in 1413 bytes} [Tue Aug 30 04:24:51 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/d52a6871-ab87-4c71-bcad-a2ded47f07aa => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:52.054397 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:52.054896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:52.064681 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.065461 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.070613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.071542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.072156 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.072694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.118624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:52.198836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lazy-loading 'services' on Instance uuid a2f09a45-d079-472f-9a0f-45714441aca5 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:24:52.223444 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:52.236808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:52.238208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:52.239401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f46f1fd0-8896-4b8e-ab1a-173fd33991cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.237125 Aug 30 04:24:52.250283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 376/727] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:52 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:52.318270 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fad86d20-6cf5-4ada-81f7-95b1d6d79702 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/d52a6871-ab87-4c71-bcad-a2ded47f07aa" status: 202 len: 0 microversion: 2.1 time: 0.267269 Aug 30 04:24:52.319231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 352/728] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:24:52 2022] DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments/d52a6871-ab87-4c71-bcad-a2ded47f07aa => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:24:53.021670 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.023290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.030752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.031507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.032088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.033143 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.033745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.034336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.199794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.208168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-261e219c-1d99-4a4c-a35f-496ffdd60a4f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.190475 Aug 30 04:24:53.209036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 377/729] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:53.268527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.270215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.280697 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.281096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.281533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.282236 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.283472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.284058 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.446340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.455542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.457068 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.458168 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-26df675f-67f2-4718-8897-7bfc4a1999a3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1741 microversion: 2.20 time: 0.197209 Aug 30 04:24:53.458750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 353/730] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:53.512183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.514617 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.522057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.522582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.523017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.523710 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.524158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.524580 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.528883 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:53.557281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-25075daa-223d-45df-8f43-d53dcd2a5dea tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050128 Aug 30 04:24:53.557830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 378/731] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:24:53.671809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.674070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.680137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.680620 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.681054 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.681752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.682204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.682656 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.711964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-68dac222-ed33-40a6-87f2-13eb1d49e441 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044031 Aug 30 04:24:53.712525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 354/732] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:24:53.775280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.775771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.781669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.782141 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.782602 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.783273 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.783715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.784127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.809290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:24:53.890641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b2a871af-fa48-4ec5-b920-8256d3a9c184 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 204 len: 0 microversion: 2.1 time: 0.119158 Aug 30 04:24:53.891412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 379/733] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:24:53 2022] DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:24:53.899882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:53.900616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.908182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.908671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.909154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.909869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.910359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.910782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.046179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.053831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d2ee7532-3869-4e01-bf3c-51d2db699b01 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1674 microversion: 2.1 time: 0.157900 Aug 30 04:24:54.054436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 355/734] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:54.231107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:54.231842 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:54.238309 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.238790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.239221 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.239911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.240362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.240781 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.374509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.382206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-96c86ce7-7c14-4b58-b82b-ff4786f08a5d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.156062 Aug 30 04:24:54.382810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 380/735] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:54 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:54.481059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:54.481659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:54.488050 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.488525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.488955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.489633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.490110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.490547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.636893 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.645109 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.646572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:54.647714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5af79412-4991-4d4f-a993-5b1219a31af3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1723 microversion: 2.20 time: 0.170594 Aug 30 04:24:54.648295 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 356/736] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:54 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:55.075256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:55.075784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:55.081785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.082281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.082735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.083447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.083899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.084319 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.215822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.223504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d53bbe4b-10d1-4a76-8a45-394eb48314b2 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1674 microversion: 2.1 time: 0.152280 Aug 30 04:24:55.224065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 381/737] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:55 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:55.404552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:55.405189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:55.411292 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.411780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.412206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.412891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.413335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.413752 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.551293 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.559101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-94625890-b907-4bd8-8135-6792342b6830 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.159059 Aug 30 04:24:55.559679 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 357/738] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:55 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:55.671507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:55.672048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:55.678405 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.678882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.679310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.679990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.680435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.680882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.813701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.822291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.824365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.825723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d1fe3ea0-8c05-40de-a5e4-4d4b91cb40e0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1723 microversion: 2.20 time: 0.158216 Aug 30 04:24:55.826133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 382/739] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:55 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:56.245984 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.246645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:56.253424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.253919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.254399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.255114 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.255592 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.256026 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.570433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:56.572719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:56.579673 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a64dddbc-dda0-4ad1-a140-0e7c62c1e7f9 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1674 microversion: 2.1 time: 0.338349 Aug 30 04:24:56.580274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 358/740] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1674 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:56.583159 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.584172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:56.593173 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.593877 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.594569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.595585 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.596255 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.597189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.744769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:56.753398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-50ae8bfe-7c72-4423-8c1b-4b09ee90ea91 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.176757 Aug 30 04:24:56.753984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 383/741] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:56.849011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.849615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:56.857130 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.857597 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.858028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.858740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.859192 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.859614 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.189566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.197683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.200089 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.201267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14b871d3-fce4-45a6-8bb3-74ac8e4cc9da tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1723 microversion: 2.20 time: 0.356201 Aug 30 04:24:57.201836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 359/742] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:57.600822 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:57.606055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:57.612708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.613439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.613927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.614607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.615161 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.615463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.653366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f09a45-d079-472f-9a0f-45714441aca5", "name": "network-vif-deleted", "tag": "4b5eb000-c8f0-4513-96d5-77d22b2b35ca"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:57.663479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.664056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.664555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.677247 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] Creating event network-vif-deleted:4b5eb000-c8f0-4513-96d5-77d22b2b35ca for instance a2f09a45-d079-472f-9a0f-45714441aca5 on hv-cinder-85220 Aug 30 04:24:57.682790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-a91b6109-d30c-4be1-89df-81823740603c req-5c15c8cc-1a54-4a1d-8a06-ff5a5c772972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Aug 30 04:24:57.684205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 360/743] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:57.691167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.701238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4da419d4-64cb-405d-90e3-a614993a0b40 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1606 microversion: 2.1 time: 0.103787 Aug 30 04:24:57.706392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 384/744] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:57 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:57.775432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:57.776473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:57.783112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.783679 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.784202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.784978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:57.785497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:57.786019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:57.938729 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.946416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-fdd67b8f-f3f8-4639-b5e8-ad3215674809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.175370 Aug 30 04:24:57.946992 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 361/745] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:57 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:58.224795 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.225523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:58.232046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.232525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.232956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.233654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.234104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.234551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.254570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "name": "network-vif-unplugged", "status": "completed", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:58.265035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.265807 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.266282 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.281497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] Creating event network-vif-unplugged:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:24:58.283881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-032cb840-6d35-4850-bd19-0a2985628e73 req-44243f8a-16fe-4915-9519-bfb41e58f1ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032981 Aug 30 04:24:58.284682 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 362/746] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:58.372802 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:58.381440 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:58.382915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:58.384099 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3f2ff4bd-13bc-4e09-b5ba-61e78046b9aa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1723 microversion: 2.20 time: 0.163287 Aug 30 04:24:58.384666 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 385/747] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:58.723731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.724423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:58.730631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.731119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.731545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.732237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.732685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.733101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.799365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d18f6efa1f4c91a6f213c095c507a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a89b6f21ff24eafbed378c2ece79c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:58.809708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e0627162-1e6b-4f25-bee0-cb4ae155a12e tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 200 len: 1606 microversion: 2.1 time: 0.090602 Aug 30 04:24:58.813291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 363/748] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:58.968483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.969413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:58.977087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.977716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.978162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.979009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.979647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.980171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.183939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:59.192130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6d91bf45-29d3-41e1-85a0-c45b9d9c2376 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.228377 Aug 30 04:24:59.192722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 386/749] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:59.408197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:59.408800 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:59.414774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.415245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.415667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.416349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.416781 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.417201 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.552569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:59.561318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:59.563039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:59.564353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-08e736aa-0929-460a-bf41-619cf75618e2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1726 microversion: 2.20 time: 0.160117 Aug 30 04:24:59.564919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 364/750] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:59 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:59.590167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c22b28-25f3-4cdb-adca-9bcefe19894d"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:59.592888 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:59.600268 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.601134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.601487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.602198 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.602688 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.603136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.831543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:59.832366 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:59.839378 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.840605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.840605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.841404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:59.841927 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:59.842769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:59.857425 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 HTTP/1.1 Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:24:59.859241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:24:59.860933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'a2f09a45-d079-472f-9a0f-45714441aca5'} Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:59.862222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:24:59.865302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:24:59.868084 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:59.868966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5db226ca-0dc9-4b2a-a56f-3b02260e6077 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 404 len: 111 microversion: 2.1 time: 0.041883 Aug 30 04:24:59.869574 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 365/751] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:59 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:59.879450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6b5922b7-6762-4351-b020-b2cc5f55600c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '.version_select at 0x7faa0d4499d0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:59.902445 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d7c59c70-7792-4257-bc68-92bc05fa518d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317847 Aug 30 04:24:59.903638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6b5922b7-6762-4351-b020-b2cc5f55600c tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585378442" status: 202 len: 0 microversion: 2.1 time: 0.028528 Aug 30 04:24:59.904978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 366/752] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 30 04:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585378442 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:24:59.915626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 387/753] 10.222.0.46 () {62 vars in 1364 bytes} [Tue Aug 30 04:24:59 2022] POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:25:00.068118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:00.068806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:00.077949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.078504 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.078901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.079596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.080037 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.080452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.212956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:00.213557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:00.221429 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.222279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.222722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.223421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.223874 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.224276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.368906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-eae09e3e-7094-47aa-b48b-a24f11805915 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments/09c22b28-25f3-4cdb-adca-9bcefe19894d" status: 202 len: 0 microversion: 2.20 time: 0.306033 Aug 30 04:25:00.369508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 367/754] 10.222.0.46 () {60 vars in 1457 bytes} [Tue Aug 30 04:25:00 2022] DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments/09c22b28-25f3-4cdb-adca-9bcefe19894d => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:25:00.374957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "name": "network-vif-plugged", "status": "completed", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:00.386624 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.388243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.388827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.401331 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] Creating event network-vif-plugged:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:25:00.406369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-8fadacee-5978-4af5-8774-f7e41520b026 req-611f3609-ddf6-4edd-af9d-8665cf1359c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Aug 30 04:25:00.410368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 368/755] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:00.430943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:00.440068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-88e5a526-6762-4da3-92e9-ef7eac6cb809 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.231174 Aug 30 04:25:00.440638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 388/756] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:00 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:00.442163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:00.442949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:00.449738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.450062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.450769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.451520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.452034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.452453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.482789 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120495) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:25:00.559783 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-50051e91-1026-49de-9a3b-a862dbdc3d9b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/action" status: 202 len: 0 microversion: 2.20 time: 0.122514 Aug 30 04:25:00.560556 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 369/757] 10.222.0.46 () {62 vars in 1319 bytes} [Tue Aug 30 04:25:00 2022] POST /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:00.568391 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:00.569350 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:00.576116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.577720 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.578488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.579421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.580076 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.580703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.845112 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:00.854503 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:00.856832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:00.857998 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3c005fea-50e5-42a6-b1a8-9c703c0d16fa tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1674 microversion: 2.20 time: 0.293532 Aug 30 04:25:00.858579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 389/758] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:00 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:01.465931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:01.466558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:01.469763 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:01.473479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.474108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.474905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.475329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.475775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.476185 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.794928 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:01.802796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9bc77abc-624c-4078-991d-a3eebd46322d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1260 microversion: 2.1 time: 0.341658 Aug 30 04:25:01.803347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 370/759] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:01 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1260 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:01.883033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:01.883672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:01.890392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.890873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.891304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.891991 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:01.892435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:01.893115 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:01.912725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:02.062211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:02.071104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:02.072551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:02.073825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-07d8f375-387d-4488-8e41-8770fc8dc030 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.195214 Aug 30 04:25:02.074414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 390/760] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:01 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:02.824316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:02.825740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:02.832365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.832834 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.833254 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:02.833928 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.834399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.834813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.033639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.041351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a60664e1-a275-449e-a2f6-3ddcf4e00f0e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1445 microversion: 2.1 time: 0.221501 Aug 30 04:25:03.041910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 371/761] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:02 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1445 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:03.062824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.063434 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:03.070064 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.070658 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.071102 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.071803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.072256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.072684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.097430 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.098355 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:03.107714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.108203 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.108640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.109904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.110392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.111093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.216087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.224100 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-90c0ec43-3cfc-4bf0-b6ed-9be8993c9394 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1445 microversion: 2.1 time: 0.166146 Aug 30 04:25:03.224870 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 391/762] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:03 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:03.231225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.231887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:03.238376 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.242689 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.243236 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.244035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.244509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.244939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.259692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 HTTP/1.1 Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:25:03.262279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.263927 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a2f09a45-d079-472f-9a0f-45714441aca5'} Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:03.264843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.266279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.269359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:03.269967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3e2e327e-8a02-4bc0-8369-cf7667098ea7 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 404 len: 111 microversion: 2.1 time: 0.042704 Aug 30 04:25:03.273411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 392/763] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:03 2022] DELETE /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:03.279358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.280015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: a2f09a45-d079-472f-9a0f-45714441aca5] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:03.285897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.286424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.286923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.287687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:03.288074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:03.288494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.302797 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 HTTP/1.1 Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:25:03.304318 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.305843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a2f09a45-d079-472f-9a0f-45714441aca5'} Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:03.306631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. Aug 30 04:25:03.307865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:25:03.308942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance a2f09a45-d079-472f-9a0f-45714441aca5 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:03.308942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-deb2312a-c221-4761-8c2e-d6a5a28fc9a8 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5" status: 404 len: 111 microversion: 2.1 time: 0.031169 Aug 30 04:25:03.308942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 393/764] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:03 2022] GET /compute/v2.1/servers/a2f09a45-d079-472f-9a0f-45714441aca5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:03.395446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.407020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.408641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.410214 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2d7e04ce-b7a1-4ece-bcf4-a43c70126c85 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.316725 Aug 30 04:25:03.412115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 372/765] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:03 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:04.435225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.435938 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:04.443489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.444079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.444615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.445415 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.445973 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.446546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.456582 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.457106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:04.463992 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.464482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.464913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.465617 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.466074 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.466529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.480917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 HTTP/1.1 Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:25:04.482671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.484274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'daa060fe-649e-4f72-9288-d7d92a36e037'} Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:04.485319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.487160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.488488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:04.488488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6dde5b5a-c414-48e8-a03c-4a6cc02f043f tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 404 len: 111 microversion: 2.1 time: 0.031378 Aug 30 04:25:04.488488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 373/766] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:04 2022] DELETE /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:25:04.494766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.496905 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] [instance: daa060fe-649e-4f72-9288-d7d92a36e037] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:04.503003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.503411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.503950 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.504766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.505343 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.506127 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.521909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] HTTP exception thrown: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Request method failure captured: Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 HTTP/1.1 Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-27_X0LY25qRhZZuJX6oNzPab-GqwOuaW_8dd51HMqmQck77fTmIwk2AIUnHUTt4j1kwwPCyZnP_iicOvmZ9TZz0-p99ipwc-zNH8-E5p8GCDv9Zr3sjuW_E9jaNjX9PqX3YLqE1SjGj5dM1zo094GSdFg1IKz1-vpYdduVRbJvSg Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:25:04.523204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5a89b6f21ff24eafbed378c2ece79c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 5a89b6f21ff24eafbed378c2ece79c3e Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1065642161 Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 96d18f6efa1f4c91a6f213c095c507a3 Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeTestJSON-1065642161-project Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.524803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'daa060fe-649e-4f72-9288-d7d92a36e037'} Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:04.525708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. Aug 30 04:25:04.527226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:25:04.528770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] Returning 404 to user: Instance daa060fe-649e-4f72-9288-d7d92a36e037 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:04.528770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-57b67f46-1f9e-442c-bfa8-766e2f743c51 tempest-AttachVolumeTestJSON-1065642161 tempest-AttachVolumeTestJSON-1065642161-project] 10.222.0.46 "GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037" status: 404 len: 111 microversion: 2.1 time: 0.035009 Aug 30 04:25:04.528770 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 374/767] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:04 2022] GET /compute/v2.1/servers/daa060fe-649e-4f72-9288-d7d92a36e037 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:04.614525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:04.626333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:04.628061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:04.629194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b5bab91e-d906-4bc5-b0ff-2effe987a9fb tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.198751 Aug 30 04:25:04.635264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 394/768] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:04 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:05.653931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:05.658481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:05.672616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.673592 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.675301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.676803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.677539 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.678362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.086827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.098210 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.100232 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.101892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-edde223d-58d3-4a1b-bce1-000e194118a2 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.452545 Aug 30 04:25:06.103276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 375/769] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:05 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:06.251520 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:06.276016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.280674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.281253 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.310851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] Creating event network-changed:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:25:06.320108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-7582461b-cf2e-4f86-bd2a-19689da67cb8 req-80c2fe05-a224-46ad-b699-642a656b4642 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072657 Aug 30 04:25:06.321107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 395/770] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:07.125973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:07.126612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:07.143874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.155169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.155904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.156816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.157421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.158010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.490436 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.494412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:07.508985 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.518862 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.523314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8065d903-95b8-428b-b8d6-14c2043c56ad tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.401592 Aug 30 04:25:07.527422 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 376/771] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:07 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:08.572321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:08.574559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:08.584054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.586443 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.594043 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.595245 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.596530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.597334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.815937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.829316 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.830810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.832137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6333c8f2-e34d-454d-b957-ec8a957823be tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.283671 Aug 30 04:25:08.848142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 396/772] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:08 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:09.862901 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:09.864015 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:09.874412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.876546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.877945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.878772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.879240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.879667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.121296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.134022 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.137325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.139740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ee73b674-e929-4361-b5d5-75ebd5f23edf tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.285406 Aug 30 04:25:10.141863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 377/773] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:09 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:11.165333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.165999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:11.173774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.174360 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.174725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.175769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.176400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.176971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.374790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.385199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.387588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.389090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-321342ed-cfcc-43cd-985b-f71cedffd8f4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.228031 Aug 30 04:25:11.390283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 397/774] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:12.414094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.414736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:12.422090 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.422815 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.423293 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.423954 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.424394 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.424811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.561776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:12.570173 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:12.571631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:12.572781 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4ddc3391-2228-41a2-a3d2-de0443bbeb56 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.162623 Aug 30 04:25:12.573380 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 378/775] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:12 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:13.596055 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:13.596739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:13.603109 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.603591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.604026 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.605308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.605851 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.606292 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.737282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.745264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.747449 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.748608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-09602e4e-0338-47a1-8fd6-715f1a0331cd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.156639 Aug 30 04:25:13.749174 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 398/776] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:13 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:14.771926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:14.772512 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:14.779057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.779543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.779972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.780660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.781106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.781551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.013499 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.021728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.023132 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.024278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aca5e979-77ac-4ab5-af58-30988ed224e6 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.256581 Aug 30 04:25:15.024831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 379/777] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:14 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:16.046071 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.046649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:16.052517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.052993 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.053421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.054096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.054569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.054983 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.185460 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.193677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.195156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.196308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-241884c8-1559-43e6-a65c-c82631750c3c tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.154417 Aug 30 04:25:16.196865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 399/778] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:17.220302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:17.220840 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:17.227280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.227778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.228191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.228872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.229319 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.230684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.361804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.369768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.371315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.372460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-29a8c70e-89e1-453c-92f8-85cde413e70a tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.156241 Aug 30 04:25:17.373017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 380/779] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:17 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:18.395770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:18.396479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:18.402892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.403352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.404083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.404505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.404957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.405373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.531421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "name": "network-vif-plugged", "status": "completed", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:18.535796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:18.543766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.544402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.544892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.546520 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:18.548103 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:18.549493 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-edb2f1d2-f269-484a-807d-caf2cd4431b3 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.157861 Aug 30 04:25:18.550074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 400/780] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:18 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:18.572723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] Creating event network-vif-plugged:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:25:18.577966 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-826e00dd-e79d-426c-9ce5-41ac720cec51 req-e9d5e28a-c820-482e-860f-82c01b689ce7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051320 Aug 30 04:25:18.578654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 381/781] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:19.576285 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:19.576911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:19.579347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:19.585270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.585808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.586341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.587202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.587651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.588068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.721409 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.729679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.731151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.732304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0bbedd1e-2a0a-4c92-bfdd-78f2b6cd66b4 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.160215 Aug 30 04:25:19.732862 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 401/782] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:19 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:19.841679 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:19.842312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:19.848577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.849060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.849497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.850191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.850672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.851098 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.874415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-22f97667-35e7-45f0-bfb6-c0fa9c0eac52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/ips" status: 200 len: 149 microversion: 2.1 time: 0.038903 Aug 30 04:25:19.875011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 382/783] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:25:19 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:20.754971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:20.755514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:20.762184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.762735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.763171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.763872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.764329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.764754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.914770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:20.924202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:20.925651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:20.926903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e8c83208-59f6-48bb-ad2e-6b670556bc34 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1732 microversion: 2.20 time: 0.176124 Aug 30 04:25:20.927462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 402/784] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:20 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:21.236985 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a7df991-773c-4cd4-ac6c-76f2e28a8f5b"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:21.239325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:21.245854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.246411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.247164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:21.247894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.248351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.248779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:21.509585 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ae8dc950-89df-483c-9f94-a5af1b8ee380 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276533 Aug 30 04:25:21.510176 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 383/785] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:25:21 2022] POST /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:21.950518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:21.951485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:21.961608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.962085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.962539 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:21.963235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.963675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.964085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.100411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:22.109687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:22.111260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:22.112525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1b5c0aca-dc04-4310-85a2-8305d15955e7 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1719 microversion: 2.20 time: 0.166530 Aug 30 04:25:22.113172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 403/786] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:21 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:28.026569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0477ed0a-71b0-460d-a0ae-ee7666f9097d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: .version_select at 0x7faa0d4af9d0>, body: {"keypair": {"name": "tempest-keypair-1334316615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCayKFBUIp+kqQ9EQIk0u0TuyKJXzBFk9h8FWrH4ZrLYhQODMU9lI4z5wR2X6kF6ZBUIy5GE9v9b8gShHIhftNSOAAT/SYmA4LSOG2nMC961wVRSShi5fnKVPNkPPLkMKQ=="}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:28.044325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-0477ed0a-71b0-460d-a0ae-ee7666f9097d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:28.048572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-0477ed0a-71b0-460d-a0ae-ee7666f9097d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:28.072922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0477ed0a-71b0-460d-a0ae-ee7666f9097d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054046 Aug 30 04:25:28.079377 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 384/787] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:25:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:29.389254 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1781311817", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2144ee9-7e1a-4a81-ac65-28f49d99b870"}], "security_groups": [{"name": "tempest-securitygroup--244929547"}], "key_name": "tempest-keypair-1334316615", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:29.495262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] validate_networks() for [('e2144ee9-7e1a-4a81-ac65-28f49d99b870', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:25:29.940943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:25:29.941508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:25:29.941979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:25:29.942421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:25:29.942824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:25:29.951844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.952702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.953139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.954002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.954486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.954901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.973305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:29.977208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:29.988686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:25:29.991304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:30.040041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-06a46500-9f36-4de5-8f57-7bd4dd3b3565 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.655185 Aug 30 04:25:30.047018 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 404/788] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:25:30.052811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-669c48de-6ee2-4db7-b658-60d0fe126657 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:30.053661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-669c48de-6ee2-4db7-b658-60d0fe126657 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:30.120518 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-669c48de-6ee2-4db7-b658-60d0fe126657 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:30.128683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-669c48de-6ee2-4db7-b658-60d0fe126657 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1242 microversion: 2.1 time: 0.080239 Aug 30 04:25:30.129245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 385/789] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:30 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:31.153164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:31.154665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:31.161497 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.162240 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.163060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.165463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.165826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.166280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.240456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.249864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9d9a9e42-4384-4b41-b41a-17f5ebed5432 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1294 microversion: 2.1 time: 0.102148 Aug 30 04:25:31.250486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 405/790] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:31 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:32.272999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:32.273651 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:32.276046 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:32.276798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:32.282971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.283454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.283882 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.284639 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.285137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.285562 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.505856 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:32.514015 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5d0d709d-b04e-4325-aac6-eea46e790a9d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.244987 Aug 30 04:25:32.514628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 386/791] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:32 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:32.794337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779aee38-94e4-4f4f-a800-6894170e718c", "tag": "a96a63b3-d079-4678-9448-3c9eb86612f2"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:32.804920 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.805527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.806020 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.809722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=77 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:32.824108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] Creating event network-changed:a96a63b3-d079-4678-9448-3c9eb86612f2 for instance 779aee38-94e4-4f4f-a800-6894170e718c on hv-cinder-85220 Aug 30 04:25:32.829878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-a8021a94-36ea-40c5-a1dc-78074c9a6347 req-d235da11-e049-4f08-b74f-fd91d17a86b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042294 Aug 30 04:25:32.830524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 406/792] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:33.535184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:33.535842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:33.542143 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:33.542642 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:33.543491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.544340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:33.544787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:33.545202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.678531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.686773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f59f6198-6114-4d3b-a2d8-2835cb04184b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.155421 Aug 30 04:25:33.687344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 387/793] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:33 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:34.708727 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:34.709417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:34.716431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.716831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.717193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.717620 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.718060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.718511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.852015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:34.859744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b1e37d85-a4cc-4b45-8d3b-faf763252620 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.155708 Aug 30 04:25:34.860322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 407/794] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:34 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:35.880600 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:35.881200 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:35.887792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.888265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.888691 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.889373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.889818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.890235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.025122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:36.033590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-91898c35-6c14-4e13-ac58-4e2efca8dbae tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.157059 Aug 30 04:25:36.034150 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 388/795] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:35 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:37.055247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.055855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:37.063464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.063944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.064375 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.065178 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.066054 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.066181 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.207675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.216105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-58588b5f-f162-4c36-9273-6538308365a0 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.164698 Aug 30 04:25:37.216732 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 408/796] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:37 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:38.237152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.237755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.244909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.245399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.245831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.247490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.248445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.248710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.384059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:38.391684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-83b9b8db-31dc-4ab1-9f18-d1f1c1be44a8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.158464 Aug 30 04:25:38.392242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 389/797] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:38.628247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779aee38-94e4-4f4f-a800-6894170e718c", "name": "network-vif-plugged", "status": "completed", "tag": "a96a63b3-d079-4678-9448-3c9eb86612f2"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:38.639075 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.639557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.640479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.652864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] Creating event network-vif-plugged:a96a63b3-d079-4678-9448-3c9eb86612f2 for instance 779aee38-94e4-4f4f-a800-6894170e718c on hv-cinder-85220 Aug 30 04:25:38.660022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-b1090896-4f01-4890-887b-41cbcc78829d req-c8a9ac56-a84d-43e2-b252-d24a8558f52c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Aug 30 04:25:38.660022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 409/798] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:39.415800 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:39.416567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:39.423479 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.424016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.424529 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.425216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.425662 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.426097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.559625 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:39.567453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dee9c38a-43df-43fd-b727-404383e1398c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.158585 Aug 30 04:25:39.568030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 390/799] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:39 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:40.593271 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:40.594502 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:40.600489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:40.601679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:40.615641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.616122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.620196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.620995 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.621754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.622785 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.825433 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.837310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-97f14af2-7970-4c07-a770-1e1b03f0c28c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1367 microversion: 2.1 time: 0.249722 Aug 30 04:25:40.837899 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 410/800] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:41.861161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.861776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.863667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:41.869833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.870347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.870785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.872321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.872917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.873346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.004788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:42.013368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f90e923b-f65a-40ee-beea-4f1c25f2e8f8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1557 microversion: 2.1 time: 0.155984 Aug 30 04:25:42.013943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 391/801] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:42.033937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:42.034494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:42.040818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.041294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.041722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.042430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.042885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.043423 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.122304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5267e84e-9043-4191-8b47-3ab15d61cb47 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092218 Aug 30 04:25:42.122909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 411/802] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:25:42 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:43.269414 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779aee38-94e4-4f4f-a800-6894170e718c", "tag": "a96a63b3-d079-4678-9448-3c9eb86612f2"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:43.280229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.280702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.281133 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.292711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] Creating event network-changed:a96a63b3-d079-4678-9448-3c9eb86612f2 for instance 779aee38-94e4-4f4f-a800-6894170e718c on hv-cinder-85220 Aug 30 04:25:43.299391 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-f99d282b-a3ae-4c47-9906-47601eb941f0 req-af0fb85d-23c5-43dd-810f-3b2522a45b74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034222 Aug 30 04:25:43.300193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 392/803] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:03.534104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:03.535505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=25 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:03.539707 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.541817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.549593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.550074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.550531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.551219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.551665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.552083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.586819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b541befe-30c1-4a22-9f43-8c3df9660b70 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054034 Aug 30 04:26:03.587338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 412/804] 10.222.0.46 () {60 vars in 1343 bytes} [Tue Aug 30 04:26:03 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:03.648714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=13 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:03.649440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=38 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:03.654398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.654986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.662085 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.662646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.663086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.665835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.665835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.665835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.690498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:03.767538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9721f381-e885-413d-b916-de00e8f67e65 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 204 len: 0 microversion: 2.20 time: 0.120300 Aug 30 04:26:03.768567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 393/805] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 30 04:26:03 2022] DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:26:03.778595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.779305 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.786712 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.787479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.787906 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.788597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.789038 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.789451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.922704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.930885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.932319 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.934181 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac2ba571-a1c0-4a02-84d9-617ea590e806 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.160644 Aug 30 04:26:03.934871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 413/806] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:03 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:04.957056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:04.957747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:04.964274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.965351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.965919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.966644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.967124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.967543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.097920 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.106816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.108398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.109566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-683369e2-dc84-44fe-b537-c9ae1ac4aea8 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.156934 Aug 30 04:26:05.110137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 394/807] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:04 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:06.133788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.134432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.141481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.141959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.142417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.143106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.143811 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.144233 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.272403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.281060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.282533 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.283682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e7680421-3007-4f14-b691-11b93d1a54b0 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.153828 Aug 30 04:26:06.284242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 414/808] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:07.306563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:07.307157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:07.313654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.314137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.314609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.315296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.315747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.316167 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.446933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.454937 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.456376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.457530 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-277994ed-9865-45d5-b053-cc8642f1a580 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.155039 Aug 30 04:26:07.458095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 395/809] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:07 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:08.482004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:08.482786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:08.489674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.490160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.490820 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.491529 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.491981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.492403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.645065 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.653841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.655312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.656535 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7ff4e67a-d1ed-472e-b9ad-42a034da5998 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1725 microversion: 2.20 time: 0.179385 Aug 30 04:26:08.657108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 415/810] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:08 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:09.291023 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6919ed2d-211e-4a0e-8ee3-09dbb72ffff1", "name": "network-vif-deleted", "tag": "62c2b20d-786c-4609-93c3-a36cc9f257d4"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:09.300681 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.301165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.301589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.312687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] Creating event network-vif-deleted:62c2b20d-786c-4609-93c3-a36cc9f257d4 for instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 on hv-cinder-85220 Aug 30 04:26:09.317695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-dfc30054-2648-4da2-bf21-1f6742301ff8 req-7c28931c-6b97-469c-8482-cc82df13c8b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Aug 30 04:26:09.321009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 396/811] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:09.679963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:09.680673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:09.689053 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.689536 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.689966 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.690713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.691158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.691572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.757209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.765933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.767400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.768879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0788387b-a855-47a4-9bf1-91b174ae038b tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1658 microversion: 2.20 time: 0.092563 Aug 30 04:26:09.769353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 416/812] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:09 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1658 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:10.793634 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.794351 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.800405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.800874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.801300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.801972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.802448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.802861 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.870039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.878628 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.880070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.881197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-03b55ede-cbf9-47dc-8354-ea958863bdbe tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1367 microversion: 2.20 time: 0.092332 Aug 30 04:26:10.881759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 397/813] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:11.904908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:11.905515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:11.912091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.912572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.913007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.913692 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.914144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.914594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.980835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.989514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.990985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c30ec9810204a4685590c42707e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411b8da28bed456bbdcdb01587610b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.992117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-37e91d9f-31d0-47fd-8fb7-8fd58f7c0855 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 200 len: 1367 microversion: 2.20 time: 0.091250 Aug 30 04:26:11.992901 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 417/814] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:11 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:13.015657 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.016269 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:13.023103 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.023586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.024019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.024706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.025157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.025579 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.041903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 HTTP/1.1 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:13.043735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:13.045462 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '6919ed2d-211e-4a0e-8ee3-09dbb72ffff1'} Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:13.046516 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:13.048124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:13.049733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:13.049733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b0d56c6f-a399-4755-b3f9-11bb314bbf8d tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 404 len: 111 microversion: 2.20 time: 0.033876 Aug 30 04:26:13.049733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 398/815] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:13 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:13.054040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c391f438-e928-4a69-96cc-2ffaaca22ccc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '.version_select at 0x7faa0d51b430>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.072926 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c391f438-e928-4a69-96cc-2ffaaca22ccc tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045796388" status: 204 len: 0 microversion: 2.20 time: 0.022649 Aug 30 04:26:13.073610 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 418/816] 10.222.0.46 () {60 vars in 1262 bytes} [Tue Aug 30 04:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045796388 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:26:14.891246 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.891750 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:14.899099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.899584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.900027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.900947 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.901259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.901682 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.915642 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 HTTP/1.1 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:14.917357 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.918943 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '6919ed2d-211e-4a0e-8ee3-09dbb72ffff1'} Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:14.919728 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.921160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.922784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:14.922784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5d92c388-ba57-4a68-acf9-3c3ad5bfabd5 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 404 len: 111 microversion: 2.20 time: 0.032369 Aug 30 04:26:14.922784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 399/817] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 30 04:26:14 2022] DELETE /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:14.928343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.928957 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:14.936499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.936980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.937412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.938108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.938586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.939015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.956952 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 HTTP/1.1 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:14.958648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.960202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '6919ed2d-211e-4a0e-8ee3-09dbb72ffff1'} Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:14.961046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. Aug 30 04:26:14.962371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:14.963505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance 6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:14.963505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-abed44b6-a420-46ce-8330-6c07e3383647 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1" status: 404 len: 111 microversion: 2.20 time: 0.036389 Aug 30 04:26:14.963505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 419/818] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/servers/6919ed2d-211e-4a0e-8ee3-09dbb72ffff1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:26:16.100433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.100922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:16.107869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.108348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.108782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.109470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.109949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.110399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.124825 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 HTTP/1.1 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:16.126459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.128035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'a3ff227a-e878-4f20-b2e7-1d0fac6fb242'} Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:16.128772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.130171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.131746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:16.131746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-78ff6c10-7736-4e6b-9bb5-3dbe0e6c63dd tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 404 len: 111 microversion: 2.20 time: 0.031496 Aug 30 04:26:16.131746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 400/819] 10.222.0.46 () {60 vars in 1280 bytes} [Tue Aug 30 04:26:16 2022] DELETE /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:16.137105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.137715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] [instance: a3ff227a-e878-4f20-b2e7-1d0fac6fb242] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:16.144362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.144835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.145281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.146000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.146468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.146887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.160122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] HTTP exception thrown: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Request method failure captured: Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 HTTP/1.1 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDY-8vNdyRLEyn-nwZFU4E9TEbXKGqiqdifr8zdvu-ntihyB40ZbwDI0vx9lWzLEQ4Xb4eCk-SlXvJvARbMZp_pr5CnHPCJjiVtQyGQld66JlWvxKcQKzxK6N7KMxRQLp2FvguzscFz9Qz9uZKElooiromUI1sD56T49XeKyO8LRyedw Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:16.161631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_411b8da28bed456bbdcdb01587610b47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/411b8da28bed456bbdcdb01587610b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 411b8da28bed456bbdcdb01587610b47 Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308236962 Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 8c30ec9810204a4685590c42707e41f8 Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308236962-project Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.163392 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a3ff227a-e878-4f20-b2e7-1d0fac6fb242'} Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:16.164436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. Aug 30 04:26:16.166458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:16.168569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] Returning 404 to user: Instance a3ff227a-e878-4f20-b2e7-1d0fac6fb242 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:16.168569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5b4841b3-86a4-43ca-9da9-c84c808a9d00 tempest-AttachVolumeShelveTestJSON-1308236962 tempest-AttachVolumeShelveTestJSON-1308236962-project] 10.222.0.46 "GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242" status: 404 len: 111 microversion: 2.20 time: 0.030206 Aug 30 04:26:16.168569 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 420/820] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/servers/a3ff227a-e878-4f20-b2e7-1d0fac6fb242 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:20.999373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0793314c-3799-4fbb-aed4-42b941571641 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Action: 'create', calling method: .version_select at 0x7faa0d5a7940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1637198400"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:21.290572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0793314c-3799-4fbb-aed4-42b941571641 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.403801 Aug 30 04:26:21.291283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 401/821] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Aug 30 04:26:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:26:21.303967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8dcc1e5f-345b-44dc-abbd-1b10745210bf tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d596a60>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:21.354775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8dcc1e5f-345b-44dc-abbd-1b10745210bf tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 200 len: 345 microversion: 2.1 time: 0.054788 Aug 30 04:26:21.359990 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 421/822] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:21 2022] GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:22.369020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ddc198bf-6110-46a6-9328-bd89186ae4eb tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d4afee0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.416169 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ddc198bf-6110-46a6-9328-bd89186ae4eb tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 200 len: 346 microversion: 2.1 time: 0.051539 Aug 30 04:26:22.416810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 402/823] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:22.430504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1c5b0d6d-d5b6-4253-a822-c9dec5073183 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Action: 'create', calling method: .version_select at 0x7faa0d52ae50>, body: {"snapshot": {"volume_id": "ff80f75e-64a8-4b1e-b763-3c594289db80", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1839216552"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:22.587162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1c5b0d6d-d5b6-4253-a822-c9dec5073183 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160896 Aug 30 04:26:22.587834 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 422/824] 10.222.0.46 () {60 vars in 1162 bytes} [Tue Aug 30 04:26:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:22.600586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2d3b8d5b-0eb7-4aef-bb3f-6bcb8ba29458 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d5d4940>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.632458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2d3b8d5b-0eb7-4aef-bb3f-6bcb8ba29458 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 287 microversion: 2.1 time: 0.036999 Aug 30 04:26:22.633057 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 403/825] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:22.645256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a837c92d-bfb5-41e1-93d7-8975dbb00894 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d508f70>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.680207 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a837c92d-bfb5-41e1-93d7-8975dbb00894 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038917 Aug 30 04:26:22.680780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 423/826] 10.222.0.46 () {58 vars in 1140 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:22.692691 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-687a33ba-d4f7-403a-b196-9491ed08cc51 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d556700>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.721992 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-687a33ba-d4f7-403a-b196-9491ed08cc51 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 287 microversion: 2.1 time: 0.033051 Aug 30 04:26:22.722589 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 404/827] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:23.735258 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-432fed7e-8624-4cfa-9e6a-ce68819fa3b4 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d55dc10>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:23.765606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-432fed7e-8624-4cfa-9e6a-ce68819fa3b4 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 287 microversion: 2.1 time: 0.034905 Aug 30 04:26:23.766183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 424/828] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:23 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:24.779537 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4857a1e3-fe11-4e17-8bbe-2584b35ee5d9 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d451790>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.810301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4857a1e3-fe11-4e17-8bbe-2584b35ee5d9 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 287 microversion: 2.1 time: 0.035630 Aug 30 04:26:24.810876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 405/829] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:25.823390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7d40d933-ffa3-46de-a3dc-0b7cb3c42377 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d520700>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.853183 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7d40d933-ffa3-46de-a3dc-0b7cb3c42377 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 288 microversion: 2.1 time: 0.034157 Aug 30 04:26:25.853736 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 425/830] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:25.866722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d830f91a-cef7-494c-a268-331285cd3948 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d5d4940>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.923233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d830f91a-cef7-494c-a268-331285cd3948 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 202 len: 0 microversion: 2.1 time: 0.061029 Aug 30 04:26:25.923801 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 406/831] 10.222.0.46 () {58 vars in 1254 bytes} [Tue Aug 30 04:26:25 2022] DELETE /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:25.932026 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d372ffa5-402a-4f0d-8f99-b92c0ca8ab05 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d55dc10>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.963674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d372ffa5-402a-4f0d-8f99-b92c0ca8ab05 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 200 len: 287 microversion: 2.1 time: 0.035424 Aug 30 04:26:25.964264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 426/832] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:26.973731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:26.974514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:26.978762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8def6afc-ea49-40c2-bbc7-9bc6c2dd5cd0 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d5a73a0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.005460 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-8def6afc-ea49-40c2-bbc7-9bc6c2dd5cd0 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] HTTP exception thrown: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8def6afc-ea49-40c2-bbc7-9bc6c2dd5cd0 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Request method failure captured: Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c HTTP/1.1 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZFsjrRigqUk3HSZPZ7_RCDnY8oU_jZQrGtb_68vHCE9OV81XJj1pMTAs5brn-0iLJ0NkttgEfrhG0IqOpNGRDPRthCsBAqBK7xRnjBFwR_JPAIeB5z1myjYiJfgXZpkKa6Cd9NXVTMygRBRYQy2MJj_E9bLnzyZQhTCs0Sin5viytw Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:27.008373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18aa4b5d08004df59401773d97b1f545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b2825f64b838452cbc1c962802757439 Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '85692e98-ba5e-45c8-b66c-cd9655a2f22c'} Aug 30 04:26:27.009978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. (HTTP 404) (Request-ID: req-0fafeeb4-f0ba-4e07-a8dc-043467f7da80) Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.010925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:27.013213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 04:26:27.014612 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8def6afc-ea49-40c2-bbc7-9bc6c2dd5cd0 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Returning 404 to user: Snapshot 85692e98-ba5e-45c8-b66c-cd9655a2f22c could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8def6afc-ea49-40c2-bbc7-9bc6c2dd5cd0 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c" status: 404 len: 111 microversion: 2.1 time: 0.036911 Aug 30 04:26:27.016064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 407/833] 10.222.0.46 () {58 vars in 1251 bytes} [Tue Aug 30 04:26:26 2022] GET /compute/v2.1/os-snapshots/85692e98-ba5e-45c8-b66c-cd9655a2f22c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:27.019437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f7ed153-4875-473d-aed5-5adc1d10b0b9 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d574940>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.025711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:27.026459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=40 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:27.082307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6f7ed153-4875-473d-aed5-5adc1d10b0b9 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 202 len: 0 microversion: 2.1 time: 0.066934 Aug 30 04:26:27.082886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 427/834] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:27 2022] DELETE /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:27.092063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-457f480c-210e-4f65-98cd-451790603311 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d556430>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.140557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-457f480c-210e-4f65-98cd-451790603311 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 200 len: 345 microversion: 2.1 time: 0.053093 Aug 30 04:26:27.141138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 408/835] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:28.155657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-662dacb2-456e-426d-9786-e6d82e0200e7 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d508c10>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:28.184530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-662dacb2-456e-426d-9786-e6d82e0200e7 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] HTTP exception thrown: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-662dacb2-456e-426d-9786-e6d82e0200e7 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Request method failure captured: Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 HTTP/1.1 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZFsjrRigqUk3HSZPZ7_RCDnY8oU_jZQrGtb_68vHCE9OV81XJj1pMTAs5brn-0iLJ0NkttgEfrhG0IqOpNGRDPRthCsBAqBK7xRnjBFwR_JPAIeB5z1myjYiJfgXZpkKa6Cd9NXVTMygRBRYQy2MJj_E9bLnzyZQhTCs0Sin5viytw Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:28.194212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18aa4b5d08004df59401773d97b1f545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b2825f64b838452cbc1c962802757439 Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'ff80f75e-64a8-4b1e-b763-3c594289db80'} Aug 30 04:26:28.195577 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. (HTTP 404) (Request-ID: req-f65d7178-a72c-41ad-8441-6db22a0a72b4) Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.196499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:28.198082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:26:28.199825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-662dacb2-456e-426d-9786-e6d82e0200e7 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Returning 404 to user: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-662dacb2-456e-426d-9786-e6d82e0200e7 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 404 len: 109 microversion: 2.1 time: 0.044557 Aug 30 04:26:28.201907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 428/836] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:28 2022] GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:28.205551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70590955-9f50-40d9-a65f-0ca4bded69aa tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d5a7ee0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:28.234476 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-70590955-9f50-40d9-a65f-0ca4bded69aa tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] HTTP exception thrown: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70590955-9f50-40d9-a65f-0ca4bded69aa tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Request method failure captured: Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 HTTP/1.1 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZFsjrRigqUk3HSZPZ7_RCDnY8oU_jZQrGtb_68vHCE9OV81XJj1pMTAs5brn-0iLJ0NkttgEfrhG0IqOpNGRDPRthCsBAqBK7xRnjBFwR_JPAIeB5z1myjYiJfgXZpkKa6Cd9NXVTMygRBRYQy2MJj_E9bLnzyZQhTCs0Sin5viytw Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:28.236792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18aa4b5d08004df59401773d97b1f545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b2825f64b838452cbc1c962802757439 Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'ff80f75e-64a8-4b1e-b763-3c594289db80'} Aug 30 04:26:28.238458 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. (HTTP 404) (Request-ID: req-c562b3ef-ec28-4f8b-997f-9a3a3b98ce2a) Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.239329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:28.240832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:26:28.242309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-70590955-9f50-40d9-a65f-0ca4bded69aa tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Returning 404 to user: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-70590955-9f50-40d9-a65f-0ca4bded69aa tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 404 len: 109 microversion: 2.1 time: 0.036449 Aug 30 04:26:28.243832 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 409/837] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:28 2022] DELETE /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:28.247492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e91ac0e9-b663-407b-ae74-0a3adf979c73 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Calling method '.version_select at 0x7faa0d508040>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:28.275177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-e91ac0e9-b663-407b-ae74-0a3adf979c73 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] HTTP exception thrown: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e91ac0e9-b663-407b-ae74-0a3adf979c73 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Request method failure captured: Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 HTTP/1.1 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZFsjrRigqUk3HSZPZ7_RCDnY8oU_jZQrGtb_68vHCE9OV81XJj1pMTAs5brn-0iLJ0NkttgEfrhG0IqOpNGRDPRthCsBAqBK7xRnjBFwR_JPAIeB5z1myjYiJfgXZpkKa6Cd9NXVTMygRBRYQy2MJj_E9bLnzyZQhTCs0Sin5viytw Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:28.277789 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18aa4b5d08004df59401773d97b1f545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18aa4b5d08004df59401773d97b1f545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 18aa4b5d08004df59401773d97b1f545 Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144705422 Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b2825f64b838452cbc1c962802757439 Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144705422-project Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'ff80f75e-64a8-4b1e-b763-3c594289db80'} Aug 30 04:26:28.279448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. (HTTP 404) (Request-ID: req-02719237-9bb0-4feb-b1e3-c16207339db2) Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.280427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:28.281828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:26:28.283270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e91ac0e9-b663-407b-ae74-0a3adf979c73 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] Returning 404 to user: Volume ff80f75e-64a8-4b1e-b763-3c594289db80 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e91ac0e9-b663-407b-ae74-0a3adf979c73 tempest-VolumesSnapshotsTestJSON-144705422 tempest-VolumesSnapshotsTestJSON-144705422-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80" status: 404 len: 109 microversion: 2.1 time: 0.036126 Aug 30 04:26:28.284668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 429/838] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:28 2022] GET /compute/v2.1/os-volumes/ff80f75e-64a8-4b1e-b763-3c594289db80 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:29.121278 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.121859 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.129714 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.130198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.130684 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.131434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.131891 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.132310 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.156939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d0422ef1-6296-4753-9681-d6288505431e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/ips" status: 200 len: 150 microversion: 2.1 time: 0.040039 Aug 30 04:26:29.157510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 410/839] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:29.171098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a7df991-773c-4cd4-ac6c-76f2e28a8f5b"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:29.173399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.180442 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.180941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.181367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.182451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.183018 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.184166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.268725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: POST /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/os-volume_attachments HTTP/1.1 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 74 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:29.270424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {"volumeAttachment": {"volumeId": "7a7df991-773c-4cd4-ac6c-76f2e28a8f5b"}} Aug 30 04:26:29.272034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'server_id': '779aee38-94e4-4f4f-a800-6894170e718c', 'body': {'volumeAttachment': {'volumeId': '7a7df991-773c-4cd4-ac6c-76f2e28a8f5b'}}} Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.272859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.274352 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 400 to user: Invalid volume: volume 7a7df991-773c-4cd4-ac6c-76f2e28a8f5b is already attached to instances: 711629d5-ba60-4bfd-a61e-7a06e25db924 {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-97a5711b-de8d-4400-b054-991529344156 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106181 Aug 30 04:26:29.275757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 430/840] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:26:29 2022] POST /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:26:29.281480 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.282303 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.288402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.288880 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.289316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.290020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.290490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.290917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.318764 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:29.412139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a9b684a1-1130-4138-8ff5-3c173ca1ef12 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 204 len: 0 microversion: 2.1 time: 0.135042 Aug 30 04:26:29.413022 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 411/841] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:29 2022] DELETE /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:29.422518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.423328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.430762 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.431239 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.431671 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.432359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.432834 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.434189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.568855 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:29.577149 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9db6ccf8-4cc6-421d-90b0-b380587b79da tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1682 microversion: 2.1 time: 0.159478 Aug 30 04:26:29.577724 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 431/842] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:29.719373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-330bd967-acfe-4554-b6e4-35396b803e71 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Action: 'create', calling method: .version_select at 0x7faa0d592700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-844052574", "metadata": {"Type": "work"}}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-330bd967-acfe-4554-b6e4-35396b803e71 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 121 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:29.736808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-844052574", "metadata": {"Type": "work"}}} Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:26:29.738555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-844052574', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.740389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:29.742072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:29.743506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:26:29.743506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.743506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-330bd967-acfe-4554-b6e4-35396b803e71 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.743506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-330bd967-acfe-4554-b6e4-35396b803e71 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141754 Aug 30 04:26:29.743506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 412/843] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:29.747999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f88daf2-20f7-4623-acec-2cea4a279ef5 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Action: 'create', calling method: .version_select at 0x7faa0d51bd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1037751914", "metadata": {"Type": "work"}}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f88daf2-20f7-4623-acec-2cea4a279ef5 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 120 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:29.752593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1037751914", "metadata": {"Type": "work"}}} Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: Aug 30 04:26:29.754148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037751914', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi '0' Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.755235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:29.757365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:29.759362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:26:29.759362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.759362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6f88daf2-20f7-4623-acec-2cea4a279ef5 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.759362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6f88daf2-20f7-4623-acec-2cea4a279ef5 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009999 Aug 30 04:26:29.759362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 432/844] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:29.766608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d45f88c5-2ebc-4c01-bcd0-8ce535045b2e tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Action: 'create', calling method: .version_select at 0x7faa0d5a7940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-771902874", "metadata": {"Type": "work"}}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d45f88c5-2ebc-4c01-bcd0-8ce535045b2e tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 118 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:29.770584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-771902874", "metadata": {"Type": "work"}}} Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:26:29.772174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-771902874', 'metadata': {'Type': 'work'}}}} Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi '' Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.773235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:29.774945 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:29.776347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:26:29.776347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.776347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d45f88c5-2ebc-4c01-bcd0-8ce535045b2e tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.776347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d45f88c5-2ebc-4c01-bcd0-8ce535045b2e tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012833 Aug 30 04:26:29.776347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 413/845] 10.222.0.46 () {60 vars in 1156 bytes} [Tue Aug 30 04:26:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:29.783436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d3806e82-6ad4-4944-a162-a0f0d86a7e43 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Calling method '.version_select at 0x7faa0d520b80>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.813559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-d3806e82-6ad4-4944-a162-a0f0d86a7e43 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] HTTP exception thrown: Volume tempest-invalid-547015807 could not be found. Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d3806e82-6ad4-4944-a162-a0f0d86a7e43 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-547015807 HTTP/1.1 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:29.815514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Volume tempest-invalid-547015807 could not be found. Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'tempest-invalid-547015807'} Aug 30 04:26:29.817091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-547015807 could not be found. (HTTP 404) (Request-ID: req-fce13d70-500e-4390-abed-f2bdad88dee8) Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.818139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:29.820130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-547015807 could not be found. Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:29.821579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-547015807 could not be found. Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-547015807 could not be found. Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d3806e82-6ad4-4944-a162-a0f0d86a7e43 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 404 to user: Volume tempest-invalid-547015807 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d3806e82-6ad4-4944-a162-a0f0d86a7e43 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-547015807" status: 404 len: 98 microversion: 2.1 time: 0.037627 Aug 30 04:26:29.823147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 433/846] 10.222.0.46 () {58 vars in 1215 bytes} [Tue Aug 30 04:26:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-547015807 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:29.827283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e7ab8989-07ee-4814-98f3-6131aea797b6 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003882 Aug 30 04:26:29.827775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 414/847] 10.222.0.46 () {58 vars in 1140 bytes} [Tue Aug 30 04:26:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:26:29.836447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7a360627-c88a-401f-a8aa-f26c669bf10e tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003842 Aug 30 04:26:29.836941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 434/848] 10.222.0.46 () {58 vars in 1137 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:26:29.845930 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d301202d-1b73-4a35-ae84-f998dbacce12 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Calling method '.version_select at 0x7faa0d592550>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.874788 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-d301202d-1b73-4a35-ae84-f998dbacce12 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] HTTP exception thrown: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d301202d-1b73-4a35-ae84-f998dbacce12 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/os-volumes/dc0121d3-82c6-458d-8a20-80d4f34ebf21 HTTP/1.1 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:26:29.876604 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'dc0121d3-82c6-458d-8a20-80d4f34ebf21'} Aug 30 04:26:29.878152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. (HTTP 404) (Request-ID: req-07347e97-5018-4b6c-8816-18d47c7e2f1d) Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.879487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:26:29.880797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:26:29.882298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d301202d-1b73-4a35-ae84-f998dbacce12 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 404 to user: Volume dc0121d3-82c6-458d-8a20-80d4f34ebf21 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d301202d-1b73-4a35-ae84-f998dbacce12 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/dc0121d3-82c6-458d-8a20-80d4f34ebf21" status: 404 len: 109 microversion: 2.1 time: 0.035609 Aug 30 04:26:29.883778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 415/849] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:26:29 2022] DELETE /compute/v2.1/os-volumes/dc0121d3-82c6-458d-8a20-80d4f34ebf21 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:29.887940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f40f89fe-914e-4486-97ff-0999a73c5034 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Calling method '.version_select at 0x7faa0d5083a0>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.916171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-f40f89fe-914e-4486-97ff-0999a73c5034 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] HTTP exception thrown: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f40f89fe-914e-4486-97ff-0999a73c5034 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Request method failure captured: Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/os-volumes/0bd48788-0a6e-4849-97ff-029e15de73b0 HTTP/1.1 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZF1QJhrmc72HCAd0JrKAkXvt6vSQrU1gWiNg_41IPW7pECk4pJ_73cbBBIYr7nyEmvP_DxdMkD1NqHztttUq3GmlYZpmLR-_kyC0SD0JyhDkrEpOYd8cFSf-_DQlLyfKglm49IWgrwKiXnGVnWLazHPrX4wkGBuq8lx0G414qKwL6Y Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:29.918902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49a91297c79848ecb786f3c1c75a7930"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 49a91297c79848ecb786f3c1c75a7930 Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-1853727779 Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 882eba86d1c34c158f69f562fe127ffa Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-1853727779-project Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '0bd48788-0a6e-4849-97ff-029e15de73b0'} Aug 30 04:26:29.920468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. (HTTP 404) (Request-ID: req-0d860b67-c94c-4873-92bb-1a5547aadc6b) Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.922284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:26:29.923641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:26:29.924885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f40f89fe-914e-4486-97ff-0999a73c5034 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] Returning 404 to user: Volume 0bd48788-0a6e-4849-97ff-029e15de73b0 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f40f89fe-914e-4486-97ff-0999a73c5034 tempest-VolumesNegativeTest-1853727779 tempest-VolumesNegativeTest-1853727779-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0bd48788-0a6e-4849-97ff-029e15de73b0" status: 404 len: 109 microversion: 2.1 time: 0.036626 Aug 30 04:26:29.926091 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 435/850] 10.222.0.46 () {58 vars in 1245 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/os-volumes/0bd48788-0a6e-4849-97ff-029e15de73b0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:30.601594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:30.602606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:30.611371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:30.612149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:30.612837 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:30.613541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:30.613988 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:30.614613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:30.757547 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:30.769779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a5508081-088d-42f5-a8bf-a43a7d4191d1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1682 microversion: 2.1 time: 0.174790 Aug 30 04:26:30.770448 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 416/851] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:30 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:31.694971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779aee38-94e4-4f4f-a800-6894170e718c", "name": "network-vif-deleted", "tag": "a96a63b3-d079-4678-9448-3c9eb86612f2"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:31.708865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.709377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.709782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.724287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] Creating event network-vif-deleted:a96a63b3-d079-4678-9448-3c9eb86612f2 for instance 779aee38-94e4-4f4f-a800-6894170e718c on hv-cinder-85220 Aug 30 04:26:31.737381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-5862f15e-aa5f-4dac-9575-ee88f283aa90 req-338aed20-4ea1-47c1-a5ea-bc19362aba0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047045 Aug 30 04:26:31.740911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 436/852] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:31.791613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:31.794079 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:31.803820 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.811110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.811861 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.812609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.813230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.813847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.884623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.885123 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.885553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.886939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'fault' on Instance uuid 779aee38-94e4-4f4f-a800-6894170e718c {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:26:31.956766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.967196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6d234b55-5d09-4f62-9dd9-37d16157b9b3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 200 len: 1332 microversion: 2.1 time: 0.179362 Aug 30 04:26:31.968163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 417/853] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:31 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 1332 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:32.990304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:32.991060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:32.998148 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.998627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.999057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.999760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.000212 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.000642 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.015832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c HTTP/1.1 Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:33.017595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:26:33.019804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '779aee38-94e4-4f4f-a800-6894170e718c'} Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:33.021527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:26:33.023784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.025229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:33.025229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-62e70059-2cc8-48f3-a639-e9dfa7083b23 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 404 len: 111 microversion: 2.1 time: 0.034177 Aug 30 04:26:33.025229 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 437/854] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:32 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:33.028978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3660c499-fdfc-46b7-9ff1-a284b4dd8050 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '.version_select at 0x7faa0d4c2160>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:33.049828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3660c499-fdfc-46b7-9ff1-a284b4dd8050 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334316615" status: 202 len: 0 microversion: 2.1 time: 0.025145 Aug 30 04:26:33.050440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 418/855] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 30 04:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334316615 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:33.770736 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:33.771225 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:33.777652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.778140 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.778595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.779286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.779735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.780160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.866800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'services' on Instance uuid 711629d5-ba60-4bfd-a61e-7a06e25db924 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:26:33.944168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-16036272-c0b6-43e0-ab7d-19fdb11ade7f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments/7a7df991-773c-4cd4-ac6c-76f2e28a8f5b" status: 202 len: 0 microversion: 2.1 time: 0.177642 Aug 30 04:26:33.945025 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 438/856] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:26:33 2022] DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments/7a7df991-773c-4cd4-ac6c-76f2e28a8f5b => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:33.955141 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:33.957563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:33.965312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.965881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.967053 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.967777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.968424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.968986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.009538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b40704cc-c88f-484c-bf68-32ece44c3928 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058893 Aug 30 04:26:34.014503 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 419/857] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:33 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:35.023676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:35.025884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:35.032108 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.032514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.032946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.033639 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.034087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.034550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.066113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c7b4ec14-63ff-4860-bc67-e1e671b6deaa tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Aug 30 04:26:35.066976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 439/858] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:35 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:36.079240 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.081538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:36.088306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.088856 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.089474 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.090821 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.091325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.092038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.132595 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f279ebeb-4310-476c-9c47-44c038c20c52 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057017 Aug 30 04:26:36.136607 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 420/859] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:37.146075 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:37.148277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:37.155385 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:37.157368 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:37.157812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:37.158742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:37.159016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:37.159463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:37.192119 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-71791463-3536-4967-80cd-37ead486fef8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050233 Aug 30 04:26:37.192680 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 440/860] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:37 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:38.204925 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:38.207151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:38.213483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.213957 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.214569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.215418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.215872 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.216291 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.245164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-500cb2ee-187e-4f44-8b44-aba884b8b30d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 30 04:26:38.246300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 421/861] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:38 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:39.256989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:39.259404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:39.266770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.267249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.267689 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.268436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.269092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.269513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.301000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4d404227-b54e-417c-a973-77a7fadf1130 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Aug 30 04:26:39.301564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 441/862] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:39 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:40.313574 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.315762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.322231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.322744 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.323174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.323876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.324320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.324741 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.354194 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-33efa296-2e31-4379-9fcf-9e29918d567a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044860 Aug 30 04:26:40.354795 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 422/863] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:26:40 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:26:40.429145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.429807 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.436552 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.437034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.437471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.438222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.438695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.439114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.465351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:40.560634 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-786d186e-f5b8-49f4-ae04-e858b5ceee7c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 204 len: 0 microversion: 2.1 time: 0.135070 Aug 30 04:26:40.561128 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 442/864] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:40 2022] DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:40.569746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.570400 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.576405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.576918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.577354 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.578051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.578564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.578992 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.708847 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:40.717160 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14f12978-9ce5-4d67-879b-5ec4143e2336 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1678 microversion: 2.1 time: 0.151386 Aug 30 04:26:40.717731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 423/865] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:40 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:41.738977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:41.739833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:41.747070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.747641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.748078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.748770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.749329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.749763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.904379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.913247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-37d77187-aab5-4719-8382-836b1d9aa212 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1678 microversion: 2.1 time: 0.178260 Aug 30 04:26:41.913722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 443/866] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:41 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:42.942195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.942856 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.952129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.952875 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.953483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.954170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.954817 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.955412 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.983069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711629d5-ba60-4bfd-a61e-7a06e25db924", "name": "network-vif-deleted", "tag": "d8e07c04-5a1e-4b74-8720-2de48fec19b7"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:43.017814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:43.023627 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:43.029694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:43.068493 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] Creating event network-vif-deleted:d8e07c04-5a1e-4b74-8720-2de48fec19b7 for instance 711629d5-ba60-4bfd-a61e-7a06e25db924 on hv-cinder-85220 Aug 30 04:26:43.085997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-0ae2b081-8cf9-4101-b50d-3eba2726a23f req-01b024a7-3a98-4e55-87dc-a8f593da3d14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108316 Aug 30 04:26:43.087759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 444/867] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:43.087907 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:43.106777 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c63d8fca-97c7-4225-9d12-ec789b1deb38 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 200 len: 1611 microversion: 2.1 time: 0.174821 Aug 30 04:26:43.108764 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 424/868] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 1611 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:44.133634 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.134381 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:44.141182 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.141662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.142129 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.142871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.143322 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.144005 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.160345 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 HTTP/1.1 Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:26:44.161978 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:26:44.163780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '711629d5-ba60-4bfd-a61e-7a06e25db924'} Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:44.164761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:26:44.166390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:26:44.168587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:44.168587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2b78a0e8-b722-4f6c-928b-ef055e014d8b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 404 len: 111 microversion: 2.1 time: 0.034703 Aug 30 04:26:44.168587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 445/869] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:44 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:44.173125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-54e485c5-3870-495d-9357-d8b99a413fe8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '.version_select at 0x7faa0d5d4a60>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.192687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-54e485c5-3870-495d-9357-d8b99a413fe8 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79509982" status: 202 len: 0 microversion: 2.1 time: 0.023431 Aug 30 04:26:44.193277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 425/870] 10.222.0.46 () {58 vars in 1215 bytes} [Tue Aug 30 04:26:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79509982 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:44.837169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c3cf91aa-4b24-4d36-a679-213ea5956c39 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: .version_select at 0x7faa0d51b3a0>, body: {"keypair": {"name": "tempest-keypair-2000784543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK9FHMwTih8awVReN7PpCo7HE3FvgyQqI4WrqnClqmNGdqmjwR89bzDmabgJzGH+OvlYLgIz25Cgd4+hHuLM6QwDSsN2YEtQdl6Vfy9TjLwfKzHs8LlXhcSGu1PaVqwZw=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:44.853919 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-c3cf91aa-4b24-4d36-a679-213ea5956c39 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:44.857909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-c3cf91aa-4b24-4d36-a679-213ea5956c39 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:44.881069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c3cf91aa-4b24-4d36-a679-213ea5956c39 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048322 Aug 30 04:26:44.881675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 446/871] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:26:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:46.154618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1668834458", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2144ee9-7e1a-4a81-ac65-28f49d99b870"}], "security_groups": [{"name": "tempest-securitygroup--586501272"}], "key_name": "tempest-keypair-2000784543", "user_data": "}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:46.259181 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] validate_networks() for [('e2144ee9-7e1a-4a81-ac65-28f49d99b870', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:26:46.628557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:46.629044 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:46.629549 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:46.629950 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:46.630383 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:46.639583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.640054 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.640475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.641183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.641623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.642033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.659550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:46.663443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:46.674317 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:46.676694 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:46.726059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-022b5ec1-6fc8-44eb-a362-dd01a1417954 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.575909 Aug 30 04:26:46.726863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 426/872] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:46.738328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2149382f-6daa-49dd-9b77-dc4d036d0bd1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:46.738950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2149382f-6daa-49dd-9b77-dc4d036d0bd1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:46.800594 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2149382f-6daa-49dd-9b77-dc4d036d0bd1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:46.808556 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2149382f-6daa-49dd-9b77-dc4d036d0bd1 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1242 microversion: 2.1 time: 0.074556 Aug 30 04:26:46.809564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 447/873] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:46 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:47.829903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:47.830542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:47.837649 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.838136 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.838606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.839337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.839952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.840601 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.916041 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.924004 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3258401b-aeba-4264-a6ba-6706e3421834 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1312 microversion: 2.1 time: 0.098375 Aug 30 04:26:47.928932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 427/874] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:47 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:48.945104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.945775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:48.953404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.953889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.954364 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.955668 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.956089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.956537 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.101587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.110334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3b204844-04af-4111-890b-7e6745253e4e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.169055 Aug 30 04:26:49.110930 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 448/875] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:49.516969 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423b7ae-20e1-4048-bae4-bfc3dfc38816", "tag": "204d0fd0-4914-4cce-8e09-e0f23834496f"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:49.528513 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:49.529091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:49.529603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.541024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] Creating event network-changed:204d0fd0-4914-4cce-8e09-e0f23834496f for instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 on hv-cinder-85220 Aug 30 04:26:49.546968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-695307c2-5fc3-4b07-873c-8f599744766a req-388d476c-1529-4e25-877e-8d658efbb82a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038383 Aug 30 04:26:49.547591 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 428/876] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:50.132288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:50.133006 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:50.140607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.141134 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.141499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.142185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.142656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.143070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.281973 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:50.289531 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-95ac4516-55d3-45be-83b7-e677fec9447f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.161049 Aug 30 04:26:50.290105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 449/877] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:50 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:51.312780 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:51.313350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:51.320196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.320675 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.321101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.321786 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.322229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.322686 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.472662 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:51.481712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-97c55030-b1dd-4667-b572-64bacccf697a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.174364 Aug 30 04:26:51.482324 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 429/878] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:51 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:52.502491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:52.503104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:52.509481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.509969 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.510446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.511485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.512052 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.512591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.655316 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.664145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-790f1963-d31b-4284-9939-4044162aa556 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.165608 Aug 30 04:26:52.664788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 450/879] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:52 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:53.685622 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.687008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.694013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.694527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.694955 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.695840 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.696286 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.696879 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.841640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:53.851321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b2d4356a-72ce-462e-8a89-d028a0199814 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.169257 Aug 30 04:26:53.851913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 430/880] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:54.873165 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:54.873810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:54.880333 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.880816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.881251 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.881947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:54.882438 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:54.882860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.017800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:55.025654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8453f159-e756-43b2-bfd6-2a25aa79c519 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.156713 Aug 30 04:26:55.026232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 451/881] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:54 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:55.334078 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423b7ae-20e1-4048-bae4-bfc3dfc38816", "name": "network-vif-plugged", "status": "completed", "tag": "204d0fd0-4914-4cce-8e09-e0f23834496f"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:55.345861 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.346440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.346938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.359051 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] Creating event network-vif-plugged:204d0fd0-4914-4cce-8e09-e0f23834496f for instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 on hv-cinder-85220 Aug 30 04:26:55.364428 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-2d3d0df6-0866-4bdf-b5e3-6f41270bfaf7 req-c94df39b-9ea0-46ba-9589-3542a2d4d537 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Aug 30 04:26:55.365554 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 431/882] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:56.046616 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:56.047266 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:56.053980 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.054494 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.054921 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.055603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.056114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.056773 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.195061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.198910 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:56.204282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b9bd9088-59db-437d-a8ad-b3f19470f0d2 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1367 microversion: 2.1 time: 0.161700 Aug 30 04:26:56.204864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 452/883] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:56 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.227350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.228285 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.232889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.233563 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.234369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.238558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.239070 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.239459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.240198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.240825 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.241415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.251433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.393913 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.401892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-03abd818-7439-4908-8292-685dff97bd99 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1557 microversion: 2.1 time: 0.178784 Aug 30 04:26:57.402855 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 432/884] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.424223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.424223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.427326 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.428479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.434528 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.434740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.435175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.435878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.436363 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.436782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.524711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-98e7b4cb-e432-4173-8007-b76e01ac322c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104768 Aug 30 04:26:57.525314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 453/885] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:58.508021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b423b7ae-20e1-4048-bae4-bfc3dfc38816", "tag": "204d0fd0-4914-4cce-8e09-e0f23834496f"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:58.518403 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.519142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.519564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.532456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] Creating event network-changed:204d0fd0-4914-4cce-8e09-e0f23834496f for instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 on hv-cinder-85220 Aug 30 04:26:58.537456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-83365142-983b-4394-81ff-107b47fa9070 req-fb36e194-0e1a-406b-8940-6723579425d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 Aug 30 04:26:58.538242 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 433/886] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:06.790412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:06.791708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.799010 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.799839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.800519 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.801453 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.802154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.802827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.830808 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lazy-loading 'flavor' on Instance uuid 0c3b92a2-23a8-405c-b393-820424eddd08 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:06.908223 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ef065b59-6904-4240-939a-f7fb8043223c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "POST /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08/action" status: 202 len: 0 microversion: 2.1 time: 0.123140 Aug 30 04:27:06.908948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 454/887] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:27:06 2022] POST /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:27:06.918883 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.920298 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.927156 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.927720 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.928157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.928952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.929611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.930038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.091513 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:07.104363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-a0cc1360-644f-4090-9e6d-27528cd4e1b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.187724 Aug 30 04:27:07.104363 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 434/888] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:08.124107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.125650 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:08.133722 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.134507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.135202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.136184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.137559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.138219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.413792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:08.423567 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-48f79d8f-fd03-42df-bbfd-26ec5af81c1b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.303457 Aug 30 04:27:08.424879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 455/889] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:09.447934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:09.449894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:09.456541 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.457290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.457726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.458455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.458910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.459446 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.690056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:09.698443 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1b8fba7b-a268-4e50-8035-a997b0ccafcc tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.255182 Aug 30 04:27:09.706668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 435/890] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:09 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.721298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.722673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.730057 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.731454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.732538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.733787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.734304 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.734891 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.894170 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.904351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a9f6b488-db8d-4f53-aee0-c747112648d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.187093 Aug 30 04:27:10.917787 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 456/891] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:11.925300 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:11.926011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:11.940348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.941091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.941716 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.942723 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.943451 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.944060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.540180 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.558561 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-99baa5d1-d800-46cb-801f-79e61e6bc20d tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.635671 Aug 30 04:27:12.571997 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 436/892] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:11 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:13.584602 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:13.586795 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:13.599877 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.601823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.602770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.604172 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.605477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.606244 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.802117 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:13.828388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30474300-d1a7-4bb5-bc42-14dfc65941af tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.248752 Aug 30 04:27:13.829553 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 457/893] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:13 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:14.851110 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:14.851488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:14.860514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.861013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.861550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:14.862359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:14.863003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:14.863594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.045353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.055215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4649269a-e07e-448f-b1dc-74f825439814 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.208450 Aug 30 04:27:15.056086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 437/894] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:14 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:16.078456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.079184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:16.087584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.088231 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.088841 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.089717 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.090273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.090826 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:16.245021 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:16.253876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e3e8a6c5-ed3f-43de-bcbf-fec991ca7440 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.179578 Aug 30 04:27:16.266849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 438/895] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:16 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:16.337717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-3c731d1c-2882-4fd8-9c79-0d0661ee8d91 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Action: 'create', calling method: .version_select at 0x7faa0d562040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1449843651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFxqV3VIfUfVvAuoeq2srugJ7pzf5c7W3D+Esq+YRfIr5hFZ5VuY2ASSZhXuQ1IsV7mK13Vk2j450AgVL+l8nP4OOaQJ6AyqMlgV2fgqEbEaOgFY/0gLh1TW5GYKNzqsA=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:16.355646 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3c731d1c-2882-4fd8-9c79-0d0661ee8d91 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for project 59c345f38d6548cd820affce5406d62c. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:16.360004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-3c731d1c-2882-4fd8-9c79-0d0661ee8d91 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for user b301d6b1d85b4371abde52727d9b387e and project 59c345f38d6548cd820affce5406d62c. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:16.384581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-3c731d1c-2882-4fd8-9c79-0d0661ee8d91 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.316382 Aug 30 04:27:16.385293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 458/896] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:27:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:17.284491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:17.285290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:17.292233 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:17.292661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:17.293112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.293803 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:17.294283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:17.294708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.455202 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:17.466141 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-06a14ab0-a364-4634-84fb-81d54650deae tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.193008 Aug 30 04:27:17.467189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 439/897] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:17 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:18.488191 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:18.488951 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:18.497205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.497961 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.498428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.499314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.499768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.500188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.642612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:18.652329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-543c9ba0-1403-4a60-b17d-91f8ac9b4825 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.168140 Aug 30 04:27:18.652998 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 459/898] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:18 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:19.673535 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:19.674158 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:19.681615 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.682526 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.683237 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.684035 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.684486 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.684903 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.830486 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.841373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4246be18-3f94-449c-a37d-ea24dc25937b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.171144 Aug 30 04:27:19.842441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 440/899] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:19 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:20.866456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:20.867070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:20.873891 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.874398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.874833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.875521 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.875971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.876388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:21.017437 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.025864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b4fb4cfd-a125-4c10-bcdb-8a00d5d6fddb tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.163311 Aug 30 04:27:21.026538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 460/900] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:20 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:22.048838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:22.049915 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:22.056934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.057416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.058508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.059206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.059650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.060069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.290128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:22.298623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f7598d19-8d79-4cd8-aea8-15b7d4a655b4 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.254597 Aug 30 04:27:22.299206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 441/901] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:22 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:23.319972 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:23.320579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:23.328070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.328544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.328970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.329656 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:23.330106 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:23.330550 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:23.469259 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:23.477024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-286bca9e-14da-41ff-bd1f-485ad56c235c tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.160949 Aug 30 04:27:23.477592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 461/902] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:23 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:24.498381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:24.499046 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:24.505028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.505500 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.505939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.506650 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.507102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.507521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.647138 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.655527 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3283db7a-1c7d-4b0c-8ac0-cad0e237f5b5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.161203 Aug 30 04:27:24.656090 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 442/903] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:24 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:25.680837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:25.681788 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:25.688834 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.689312 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.689819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.690543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.690997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.691413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.835727 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:25.844370 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-86519122-135e-46e0-a8d7-b902bb0eac44 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1511 microversion: 2.1 time: 0.170685 Aug 30 04:27:25.845029 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 462/904] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:25 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:25.867603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:25.868206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:25.874866 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.875347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.875778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.876471 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:25.876922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:25.877337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:25.909241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120495) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:27:25.984283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-672c7c8f-9480-4189-a07c-734386758da7 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "POST /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08/action" status: 202 len: 0 microversion: 2.1 time: 0.120418 Aug 30 04:27:25.984911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 443/905] 10.222.0.46 () {60 vars in 1278 bytes} [Tue Aug 30 04:27:25 2022] POST /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:27:25.993272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:25.993882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:26.001175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.001672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.002093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.002837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.003283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.003704 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.147417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.156573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-4bef39e9-555d-469c-a54d-65878ff0ef29 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1519 microversion: 2.1 time: 0.167144 Aug 30 04:27:26.157939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 463/906] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:25 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:27.179659 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:27.180270 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:27.188230 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.188852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.189299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.189999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.190566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.191101 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.358953 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:27.362726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.371824 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e7763020-8817-4a6c-94ea-9d4aac2d70be tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1521 microversion: 2.1 time: 0.196558 Aug 30 04:27:27.372733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 444/907] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:27 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:27.471431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "name": "network-vif-unplugged", "status": "completed", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:27.478752 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=4 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.480674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.484994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.485475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.486612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.492316 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:27.504114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] Creating event network-vif-unplugged:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:27:27.509280 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-cf251420-55db-4604-8bd4-889aae0b89ad req-6fa18863-e5e5-4322-aa2e-9072a8316ae3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042068 Aug 30 04:27:27.510014 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 464/908] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:28.396347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:28.396941 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:28.399193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:28.405704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.406182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.406654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.407339 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:28.407787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:28.408205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:28.542127 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.550055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c23a63cd-1e89-4418-a7e4-3fa89f65dfd9 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.158264 Aug 30 04:27:28.550660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 445/909] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:28 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:29.572390 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.573094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:29.581542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.582017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.582753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.583194 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.583661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.584073 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.718786 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:29.726436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-af822ad8-cc98-4d58-b25d-661aab645d36 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.158614 Aug 30 04:27:29.727002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 465/910] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:30.747533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:30.748161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.754641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.755118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.755550 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.756235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:30.756683 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:30.757102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:30.891517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.899528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2a88a241-1bfc-470c-aa29-724735d2c26e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.156000 Aug 30 04:27:30.900105 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 446/911] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:30 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:31.921915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.922534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.928759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.929245 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.929686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.930422 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.930876 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.931300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.072125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:32.080415 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-69492dbe-ef48-4342-9514-cacf3bc625da tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.163621 Aug 30 04:27:32.080989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 466/912] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:32.796818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1154865257", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449843651", "security_groups": [{"name": "tempest-secgroup-smoke-759749048"}], "block_device_mapping_v2": [{"uuid": "61359161-e977-4be2-b3e5-817edba1be80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8adf9578-c481-4463-b5d1-5bddee25fe02"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:32.911546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] validate_networks() for [('8adf9578-c481-4463-b5d1-5bddee25fe02', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:27:33.100767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.101456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.108294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.108868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.109371 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.110120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.110653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.111135 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.243581 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.251542 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-052f3687-5991-40b5-ad8f-ebe736a05bda tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.154556 Aug 30 04:27:33.252118 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 467/913] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:33.282717 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:33.283137 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:33.283606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:33.284010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:33.284413 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:33.293894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.294415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.294848 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.295579 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.296027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.296445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.313154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:33.317056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for user b301d6b1d85b4371abde52727d9b387e and project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:33.377208 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:33.379367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61359161-e977-4be2-b3e5-817edba1be80',volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:33.507177 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9854abeb-fe9d-4243-be9c-1de42b1aa69b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714133 Aug 30 04:27:33.507839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 447/914] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:33.519685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1b55da15-08f0-45fb-9b87-b3a9d0609400 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.520297 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1b55da15-08f0-45fb-9b87-b3a9d0609400 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.575969 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1b55da15-08f0-45fb-9b87-b3a9d0609400 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.582791 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1b55da15-08f0-45fb-9b87-b3a9d0609400 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1095 microversion: 2.1 time: 0.067207 Aug 30 04:27:33.583349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 468/915] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.280309 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.280952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.288226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.288700 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.289121 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.289836 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.290301 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.290719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.427142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.436314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-209d2674-39c6-4f2b-a34e-b40411e192f5 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.162339 Aug 30 04:27:34.436993 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 448/916] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.603915 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.605021 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.613717 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.614190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.614645 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.615328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.615774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.616189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.833080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.841548 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ec6b5fcb-cebc-4789-9b70-96eca72c11e5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1193 microversion: 2.1 time: 0.241442 Aug 30 04:27:34.842130 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 469/917] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1193 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:35.457991 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.459199 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.466806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.471036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.473111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.474087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.475161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.475592 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.720746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:35.731794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5efb2779-afec-4a5e-9208-c5e773f10707 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.277696 Aug 30 04:27:35.732393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 449/918] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:35.864185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.865283 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:35.872819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.873428 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.874000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.875206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.876164 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.876624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.077448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.088299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d63ccc42-78d9-48d1-8853-680e80cb3041 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.227667 Aug 30 04:27:36.089035 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 470/919] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:36.268396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.269224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.277709 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.279011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.279594 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.281001 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.282265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.284122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.325048 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1c9d74b4-f385-4480-8581-57cca6297b15 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/ips" status: 200 len: 150 microversion: 2.1 time: 0.064672 Aug 30 04:27:36.329245 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 450/920] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:36.755395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.764564 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.773544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.774382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.774988 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.775895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.776715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.777777 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.856559 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a38295c3-20df-4922-b871-2b98a7c5791f", "tag": "2f13d5a1-172c-4836-9776-4995855ff63b"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:36.871566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.872052 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.872483 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.884491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] Creating event network-changed:2f13d5a1-172c-4836-9776-4995855ff63b for instance a38295c3-20df-4922-b871-2b98a7c5791f on hv-cinder-85220 Aug 30 04:27:36.890473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6f9c293a-4bc9-4fad-be3d-039e89ffc86d req-fb451116-d533-4141-b752-cb32484f5a1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038987 Aug 30 04:27:36.891229 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 451/921] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:36.942859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:36.952068 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c0a4f06f-d7bb-4346-b5fb-70a588c03c46 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.202806 Aug 30 04:27:36.952648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 471/922] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:36 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.115644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.116464 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.122972 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.123463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.123881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.124581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.125028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.125442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.337623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.347146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d9548e65-ffec-460e-9b69-dbc6d8dc1aba tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.235774 Aug 30 04:27:37.347949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 452/923] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.551249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "name": "network-vif-plugged", "status": "completed", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:37.561464 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.561942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.562895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.575037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] Creating event network-vif-plugged:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:27:37.580123 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-553efc83-e4ae-4aed-bfb1-202930fc464d req-2e28534d-5996-4557-a15b-49ed567a6173 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Aug 30 04:27:37.580763 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 472/924] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:37.765611 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "047ce694-0234-48a5-8af3-5465e2fff088"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:37.768423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.774931 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.775348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.775784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.776514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.777768 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.778170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.974819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:37.975514 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:37.982986 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.983458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.983878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.984791 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.985217 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.985701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.043348 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d44d1fd3-ba87-42a9-854b-ab875750003f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282604 Aug 30 04:27:38.044155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 453/925] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:37 2022] POST /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:38.127279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.135046 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f96f54d9-74d8-443f-b6d7-188dda8c43d6 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1577 microversion: 2.1 time: 0.165479 Aug 30 04:27:38.135624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 473/926] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:37 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:38.368495 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.369187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.376565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.377108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.377533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.378268 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.378796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.379212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.520914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.529207 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-14850b92-f2b4-4301-ae6f-fda5735ffd9d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.165618 Aug 30 04:27:38.529767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 454/927] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:39.156826 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.157528 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.163981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.164454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.164885 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.165565 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.166017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.166465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.296932 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.305745 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-fe3b5f16-c241-4846-b2a6-f7e73d2b527e tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1564 microversion: 2.1 time: 0.152740 Aug 30 04:27:39.306339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 474/928] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:39.549643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.550165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.556605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.557081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.557546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.558848 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.559369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.559781 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.692975 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.701013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e3808f63-0776-44a5-9acc-5bc4e43e31c4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.155466 Aug 30 04:27:39.701586 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 455/929] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:40.721327 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.721947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.728455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.728935 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.729383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.730155 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.730675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.731109 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.872862 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.880470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a6380ea0-4832-449b-a393-031a397ff882 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.163291 Aug 30 04:27:40.881040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 475/930] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:41.901540 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.902165 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.908773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.909252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.909708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.910455 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.910900 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.911314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.046456 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.059241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f722b0d3-d143-4ca8-a74d-83395aed9809 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.161225 Aug 30 04:27:42.060171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 456/931] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:43.083555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.084190 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.090768 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.091238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.091665 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.092341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.092790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.093202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.227559 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:43.237160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f40e0588-3e13-48d6-8dc1-9ac683182e80 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.157449 Aug 30 04:27:43.237719 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 476/932] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:44.259135 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.259704 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.262603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:44.263274 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:44.270216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.270706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.271128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.271804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.272276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.272690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.420224 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:44.429472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1204e15a-791c-4157-a29d-cc8c90c47129 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.174051 Aug 30 04:27:44.430095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 457/933] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.451905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.452573 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.454973 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:45.460868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.461349 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.461778 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.462506 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.462959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.463380 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.601669 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.602746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "047ce694-0234-48a5-8af3-5465e2fff088"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:45.606385 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.611282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-80883ee6-7619-460b-a231-0a057224cc12 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.163729 Aug 30 04:27:45.614060 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.614584 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.615025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.615730 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.616186 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.616616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.626611 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 477/934] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:45 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.701077 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: POST /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments HTTP/1.1 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 74 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:27:45.702851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {"volumeAttachment": {"volumeId": "047ce694-0234-48a5-8af3-5465e2fff088"}} Aug 30 04:27:45.705362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'server_id': 'b423b7ae-20e1-4048-bae4-bfc3dfc38816', 'body': {'volumeAttachment': {'volumeId': '047ce694-0234-48a5-8af3-5465e2fff088'}}} Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.706523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:45.708128 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 400 to user: Invalid volume: volume 047ce694-0234-48a5-8af3-5465e2fff088 is already attached to instances: b423b7ae-20e1-4048-bae4-bfc3dfc38816 {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b47f9639-8ec6-44e6-9673-487ed3d561a6 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107158 Aug 30 04:27:45.709784 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 458/935] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:45 2022] POST /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:27:45.771016 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.771534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.778033 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.778534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.778963 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.779647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.780092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.780507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.863031 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'services' on Instance uuid b423b7ae-20e1-4048-bae4-bfc3dfc38816 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:45.939863 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8be298a4-d294-4b4e-9e1c-7254e810401b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments/047ce694-0234-48a5-8af3-5465e2fff088" status: 202 len: 0 microversion: 2.1 time: 0.172842 Aug 30 04:27:45.940488 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 478/936] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:27:45 2022] DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments/047ce694-0234-48a5-8af3-5465e2fff088 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:27:45.949692 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:45.952235 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:45.959610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.960102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.960572 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.961306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:45.961760 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:45.962184 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.993851 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e5b7f95c-b9f0-4577-902b-d617fb2599de tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048870 Aug 30 04:27:45.994796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 459/937] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:45 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:46.635676 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.637204 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.643894 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.645200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.653382 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.654272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.655011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.655648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.798216 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.805831 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-220b6724-fe49-4ce6-a422-0dc36fbf2a68 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.176650 Aug 30 04:27:46.806424 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 479/938] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.007437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.009511 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.016678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.017149 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.017573 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.018272 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.018718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.019392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.050564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-96f8fe9d-70b7-4db8-bac3-fcd66ec2700d tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047219 Aug 30 04:27:47.051116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 460/939] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:27:47.113150 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.113641 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.119557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.120041 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.120492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.121147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.121593 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.122009 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.147416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:27:47.198622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:47.226072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e0d631f6-f7b7-4047-84b7-39e13734748b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 204 len: 0 microversion: 2.1 time: 0.116904 Aug 30 04:27:47.226682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 480/940] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:27:47 2022] DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:47.235205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.235819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.241674 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.242154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.242648 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.243481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.243968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.244393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.375059 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:47.378211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:47.387144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f6cb2496-6409-43fc-95e0-fef6a58df95a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1682 microversion: 2.1 time: 0.155645 Aug 30 04:27:47.387887 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 461/941] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.601409 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38295c3-20df-4922-b871-2b98a7c5791f", "name": "network-vif-plugged", "status": "completed", "tag": "2f13d5a1-172c-4836-9776-4995855ff63b"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:47.612794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.613451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.613884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.625917 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] Creating event network-vif-plugged:2f13d5a1-172c-4836-9776-4995855ff63b for instance a38295c3-20df-4922-b871-2b98a7c5791f on hv-cinder-85220 Aug 30 04:27:47.630909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-670e1dff-ee7f-4d62-b93f-52d9bea4af63 req-8fe98e86-9eab-4ddb-87e8-a154b755aa9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Aug 30 04:27:47.631503 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 481/942] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:47.827368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.827979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.834759 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.835239 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.835667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.836353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.836802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.837222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.970623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:47.978323 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ebf446b0-7724-4c6f-900d-2b73f412cc2f tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.155364 Aug 30 04:27:47.978887 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 462/943] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:48.410644 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:48.411338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:48.418592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.419069 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.419503 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.420185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.420633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.421051 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.553705 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:48.562176 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c9e7e609-5321-4fda-b106-e56f6830c301 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1682 microversion: 2.1 time: 0.155606 Aug 30 04:27:48.562845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 482/944] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:48 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.001083 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.001719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.008187 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.008672 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.009108 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.009808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.010281 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.011477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.240266 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:49.248805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2d885cf1-632b-4f7a-a32e-ab871158586d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.251646 Aug 30 04:27:49.249384 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 463/945] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:48 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.584760 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.585372 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.592396 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.592878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.593309 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.594002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.594484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.594903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.662024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:49.672448 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-6c29d61f-dc7f-40de-b46e-75ee0e594cbd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1615 microversion: 2.1 time: 0.091224 Aug 30 04:27:49.686307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 483/946] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:49 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.686558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b423b7ae-20e1-4048-bae4-bfc3dfc38816", "name": "network-vif-deleted", "tag": "204d0fd0-4914-4cce-8e09-e0f23834496f"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:49.688796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.689251 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.689689 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.705417 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] Creating event network-vif-deleted:204d0fd0-4914-4cce-8e09-e0f23834496f for instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 on hv-cinder-85220 Aug 30 04:27:49.710157 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6d3881a3-4217-41fb-8941-be60f53e9c6e req-d98f95d1-3326-47f1-a53f-ac2ae49e1289 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035008 Aug 30 04:27:49.711316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 464/947] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:50.271177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.271933 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.281938 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.282515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.282981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.283876 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.284608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.284999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.462937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:50.471504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ac32ce26-a325-488b-bf14-fe334494b6b8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1266 microversion: 2.1 time: 0.205971 Aug 30 04:27:50.472100 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 484/948] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:50.699150 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.699747 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.706521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.707260 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.707696 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.708402 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.708853 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.709275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.749845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.751071 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.751522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.752025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'fault' on Instance uuid b423b7ae-20e1-4048-bae4-bfc3dfc38816 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:27:50.811386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:50.817033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aebe15fb-9f81-489c-a9e2-e4297d504283 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 200 len: 1332 microversion: 2.1 time: 0.122718 Aug 30 04:27:50.817813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 465/949] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:51.492362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.492956 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.500015 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.500495 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.500929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.501638 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.502090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.502546 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.635999 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:51.644845 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-27bfb077-5412-4ef6-b01f-0b1e2e67dfa3 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1453 microversion: 2.1 time: 0.156047 Aug 30 04:27:51.645439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 485/950] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:51.664623 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.665258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.671633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.672106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.672532 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.673362 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.673818 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.674228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.806418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:51.815065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-efad99cf-8da6-4dda-b5ed-a96ff68667c8 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1453 microversion: 2.1 time: 0.154230 Aug 30 04:27:51.815637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 466/951] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:51.839222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.839841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.845895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.846500 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.846934 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.847626 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.848074 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.848492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.862695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 HTTP/1.1 Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:27:51.864397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:27:51.866154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'b423b7ae-20e1-4048-bae4-bfc3dfc38816'} Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:51.867186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:27:51.868544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:27:51.870716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:51.870716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ca46f5f9-aa00-4e98-810c-c86dd4db94b7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 404 len: 111 microversion: 2.1 time: 0.030747 Aug 30 04:27:51.870716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 486/952] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:27:51.875415 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0cda2d9a-4edc-4b9e-914c-bbbb3ad13e3f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '.version_select at 0x7faa0d4514c0>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.895525 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0cda2d9a-4edc-4b9e-914c-bbbb3ad13e3f tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000784543" status: 202 len: 0 microversion: 2.1 time: 0.024023 Aug 30 04:27:51.896161 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 467/953] 10.222.0.46 () {58 vars in 1221 bytes} [Tue Aug 30 04:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000784543 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:27:52.554886 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0f732560-1de1-4a6f-8127-915ea673b666 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: .version_select at 0x7faa0d52a9d0>, body: {"keypair": {"name": "tempest-keypair-867012529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEzS/lDTnSLzZyDa5rNMcgaPfYgG940GWayoxaeAzf2w6x5IMIsdqEiASHZ384KQjoODqcSXot1TOgVq3hMsWgKDD+Y3+keAEcs9up+cABORBYvEevfJyHoNkJvjAF53A=="}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:52.572093 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-0f732560-1de1-4a6f-8127-915ea673b666 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:52.577396 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-0f732560-1de1-4a6f-8127-915ea673b666 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'key_pairs'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:52.601048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0f732560-1de1-4a6f-8127-915ea673b666 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050273 Aug 30 04:27:52.601769 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 487/954] 10.222.0.46 () {60 vars in 1159 bytes} [Tue Aug 30 04:27:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:53.831831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a38295c3-20df-4922-b871-2b98a7c5791f", "tag": "2f13d5a1-172c-4836-9776-4995855ff63b"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:53.844155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.844635 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.845056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.857153 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] Creating event network-changed:2f13d5a1-172c-4836-9776-4995855ff63b for instance a38295c3-20df-4922-b871-2b98a7c5791f on hv-cinder-85220 Aug 30 04:27:53.862737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-29bd6fa5-e040-4e03-a33d-4e08100692e1 req-14314bb9-6cc5-431f-9e69-62a5e4bf2dc6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034324 Aug 30 04:27:53.864842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 468/955] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:53.954406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-214392334", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2144ee9-7e1a-4a81-ac65-28f49d99b870"}], "security_groups": [{"name": "tempest-securitygroup--1946515060"}], "key_name": "tempest-keypair-867012529", "user_data": "}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:54.080959 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] validate_networks() for [('e2144ee9-7e1a-4a81-ac65-28f49d99b870', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:27:54.486147 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:54.486595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:54.487408 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:54.487839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:54.488279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:54.497723 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.498302 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.498742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.499462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.499917 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.500338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.517609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:54.521970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Getting quotas for user 545b18260abe47ceb440d0713439c13b and project 9c9311c57fdd4250a16560bd8c2e0ffc. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:54.534384 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:54.537321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:54.585090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d1261ebd-8671-434e-9bcc-199f97dd910c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.635428 Aug 30 04:27:54.585966 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 488/956] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:54.598030 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-e36adb27-38bf-4c61-8ef3-61205ace6661 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.598994 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-e36adb27-38bf-4c61-8ef3-61205ace6661 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.658731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-e36adb27-38bf-4c61-8ef3-61205ace6661 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:54.667005 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-e36adb27-38bf-4c61-8ef3-61205ace6661 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1240 microversion: 2.1 time: 0.073249 Aug 30 04:27:54.667585 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 469/957] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:54 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:55.688435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:55.689196 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:55.696451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.696869 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.697303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.698048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:55.698635 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:55.699062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.766272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:55.777187 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-74f560a3-1016-4cf1-b1c5-4b78ad9a54fd tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1300 microversion: 2.1 time: 0.092830 Aug 30 04:27:55.778139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 489/958] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:55 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:56.799062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:56.799690 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:56.810302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.810302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.810302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.810302 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.810751 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.810751 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.023565 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:57.032473 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5615fb10-6633-4b60-8237-073b4a612c56 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.237303 Aug 30 04:27:57.032996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 470/959] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:56 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:57.098889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e08ca80-55bf-497a-9724-e515aa65f78c", "tag": "9d8726ad-314f-442c-baf1-401574c20d71"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:57.109884 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:57.110399 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:57.110829 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.124555 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] Creating event network-changed:9d8726ad-314f-442c-baf1-401574c20d71 for instance 7e08ca80-55bf-497a-9724-e515aa65f78c on hv-cinder-85220 Aug 30 04:27:57.129813 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-532c23d7-5a04-4ca4-b4c0-fc7efa53426a req-a2d9cf24-785a-4955-ba30-ef1b0801f521 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035339 Aug 30 04:27:57.131848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 490/960] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:58.054734 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:58.055497 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:58.062893 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:58.063370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:58.063797 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:58.064481 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:58.064924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:58.065337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:58.194399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:58.202688 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f10caa8a-3f8a-4470-9bde-953dd39e89c4 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.152110 Aug 30 04:27:58.203254 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 471/961] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:58 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:59.224621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:59.225306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:59.227260 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:59.233310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.233781 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.234209 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.234919 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.235369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.235781 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.366631 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:59.375911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9c33d85e-2c65-48b8-a7f8-3dc5c9161505 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.155972 Aug 30 04:27:59.376484 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 491/962] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:59 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:00.396983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:00.397578 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:00.400031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:00.405863 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.406370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.406809 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.407505 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.407958 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.408485 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.550986 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:00.558499 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4b9989ae-a0d0-4b10-b502-36d06b5fd8b9 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.165700 Aug 30 04:28:00.559063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 472/963] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:00 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:01.579230 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:01.579824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:01.586796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.587537 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.587977 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.588738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.589654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.590151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.663543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e08ca80-55bf-497a-9724-e515aa65f78c", "name": "network-vif-plugged", "status": "completed", "tag": "9d8726ad-314f-442c-baf1-401574c20d71"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:01.678042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.678560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.679146 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.692198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] Creating event network-vif-plugged:9d8726ad-314f-442c-baf1-401574c20d71 for instance 7e08ca80-55bf-497a-9724-e515aa65f78c on hv-cinder-85220 Aug 30 04:28:01.697345 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-f475ce45-6fc5-4f33-bccd-242cafba1204 req-9685e9e6-1f9b-4977-b28e-333264f52fad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040123 Aug 30 04:28:01.698502 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 473/964] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:01.742971 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:01.751792 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-04943da2-3241-4db3-ba41-4134c32107bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.176495 Aug 30 04:28:01.752431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 492/965] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:01 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:02.773601 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:02.774259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:02.781179 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.781658 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.782122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:02.782838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.783296 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.783719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:02.917569 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:02.929447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8f132ad9-d575-4927-96fe-714ae699d0e3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1366 microversion: 2.1 time: 0.160860 Aug 30 04:28:02.930036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 474/966] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:02 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:03.952487 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:03.953089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:03.959856 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:03.960338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:03.960767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:03.961468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:03.961914 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:03.962362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.095359 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:04.102960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-36f5b368-b038-4d6d-a3b9-8fd48016e703 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1556 microversion: 2.1 time: 0.154646 Aug 30 04:28:04.103525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 493/967] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:03 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:04.124005 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:04.124534 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:04.130793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.131265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.131689 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.132365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.132805 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.133215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.213215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dad44323-26bf-4de6-bf74-a9eb94789840 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093046 Aug 30 04:28:04.214459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 475/968] 10.222.0.46 () {58 vars in 1275 bytes} [Tue Aug 30 04:28:04 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:05.147444 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e08ca80-55bf-497a-9724-e515aa65f78c", "tag": "9d8726ad-314f-442c-baf1-401574c20d71"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:05.152916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:05.153579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=10 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:05.160274 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:05.160754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:05.161186 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:05.172557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] Creating event network-changed:9d8726ad-314f-442c-baf1-401574c20d71 for instance 7e08ca80-55bf-497a-9724-e515aa65f78c on hv-cinder-85220 Aug 30 04:28:05.177734 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-3ee3caca-0557-4ec6-be13-fbd6452f3c18 req-934ad522-43eb-4c0d-a9b3-39306c1e2cf2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Aug 30 04:28:05.178357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 494/969] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:41.279864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.281477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=7 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.282174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=61 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.286510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.287024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.294306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.294789 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.295213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.295892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.296335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.296746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.320011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-be5f5c5b-e104-44aa-ad3d-43bbf51f8f6b tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/ips" status: 200 len: 150 microversion: 2.1 time: 0.041038 Aug 30 04:28:41.320577 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 476/970] 10.222.0.46 () {58 vars in 1248 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:42.651837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad075500-8fb4-4e0e-9161-1114a9d25231"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:42.654441 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.656431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=7 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:42.657160 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=58 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:42.663583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.664056 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.664481 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.665168 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.665612 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.666144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.907340 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-29c3a0f3-da22-4d53-b848-1f8e82cb43bb tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "POST /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259733 Aug 30 04:28:42.908279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 495/971] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:28:42 2022] POST /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:49.490911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.491498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.497959 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.498470 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.498902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.499581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.500025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.500441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.581655 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'services' on Instance uuid 7e08ca80-55bf-497a-9724-e515aa65f78c {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:28:49.655817 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-257102e6-52ba-4740-80ad-7bc6c43a5423 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments/ad075500-8fb4-4e0e-9161-1114a9d25231" status: 202 len: 0 microversion: 2.1 time: 0.168645 Aug 30 04:28:49.656520 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 477/972] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:49 2022] DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments/ad075500-8fb4-4e0e-9161-1114a9d25231 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:28:49.666193 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.668598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.676498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.677379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.677814 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.678543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.678992 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.679413 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.712483 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e0cdc5c1-4100-44ba-a032-424e77b5082c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050984 Aug 30 04:28:49.713328 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 496/973] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:50.726873 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.729193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.737405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.738890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.738890 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.739151 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.739487 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.742192 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.774163 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6efc83aa-9aa6-40fc-ade8-ea31bf555335 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052310 Aug 30 04:28:50.774755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 478/974] 10.222.0.46 () {58 vars in 1302 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:28:50.839511 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.840051 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.846522 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.846994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.847420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.848097 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.848538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.848955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.874113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:50.952219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1dab0ea0-11a3-4ec0-9da5-c734f7f2772e tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 204 len: 0 microversion: 2.1 time: 0.116220 Aug 30 04:28:50.952810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 497/975] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:50 2022] DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:50.961610 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.962381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.968652 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.969142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.969627 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.970392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.970846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.971423 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.117042 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.126038 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3b2cd456-08cb-483f-afe1-d31aabf5c934 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1681 microversion: 2.1 time: 0.168881 Aug 30 04:28:51.126640 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 479/976] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:52.149154 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:52.150024 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:52.157461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.158145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.158583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.159085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.159523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.159940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.560774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.568836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-db58ca0c-7fad-4f5d-aaba-29f545f86aa3 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1681 microversion: 2.1 time: 0.424641 Aug 30 04:28:52.569419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 498/977] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:52 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1681 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:53.419064 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e08ca80-55bf-497a-9724-e515aa65f78c", "name": "network-vif-deleted", "tag": "9d8726ad-314f-442c-baf1-401574c20d71"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:53.430521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.431136 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.431642 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.445007 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] Creating event network-vif-deleted:9d8726ad-314f-442c-baf1-401574c20d71 for instance 7e08ca80-55bf-497a-9724-e515aa65f78c on hv-cinder-85220 Aug 30 04:28:53.449909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-936e69a7-040a-47b5-aff3-eed73c56596d req-b3f79f9e-5e17-49f9-9eba-effaf01fa3ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Aug 30 04:28:53.450543 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 480/978] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:53.592844 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:53.593541 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:53.601092 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.602066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.602749 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.603739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.604538 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.605184 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.645432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:53.645898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:53.646744 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:53.647274 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lazy-loading 'fault' on Instance uuid 7e08ca80-55bf-497a-9724-e515aa65f78c {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:28:53.689388 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b18260abe47ceb440d0713439c13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9311c57fdd4250a16560bd8c2e0ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:53.697281 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-79159fa8-09f9-4e84-b61f-23c547fac2d5 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 200 len: 1330 microversion: 2.1 time: 0.109380 Aug 30 04:28:53.697943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 499/979] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:53 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:54.720308 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.720911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.727171 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.727677 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.728111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.728793 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.729243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.729662 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.743106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c HTTP/1.1 Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:28:54.744721 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:54.746467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '7e08ca80-55bf-497a-9724-e515aa65f78c'} Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:54.751189 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:54.752802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:54.754213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:54.754213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cac54bb9-3dc0-47ca-9448-bf9e79640161 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 404 len: 111 microversion: 2.1 time: 0.030790 Aug 30 04:28:54.754213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 481/980] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:54.755406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-14cd9346-b2f8-49ae-87d8-f86fc5f2d20c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '.version_select at 0x7faa0d6ce790>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.775419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-14cd9346-b2f8-49ae-87d8-f86fc5f2d20c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867012529" status: 202 len: 0 microversion: 2.1 time: 0.023767 Aug 30 04:28:54.776177 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 500/981] 10.222.0.46 () {58 vars in 1218 bytes} [Tue Aug 30 04:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867012529 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:28:56.540870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.541442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.548490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.548968 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.549401 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.550092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.550585 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.551008 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.564713 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c HTTP/1.1 Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:28:56.566283 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.567911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '7e08ca80-55bf-497a-9724-e515aa65f78c'} Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:56.568754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.570062 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.571359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:56.571359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4baf7157-32d0-4e8a-96c6-5ad7846e0df7 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 404 len: 111 microversion: 2.1 time: 0.031925 Aug 30 04:28:56.571359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 482/982] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:56 2022] DELETE /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:56.577336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.577944 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 7e08ca80-55bf-497a-9724-e515aa65f78c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.584562 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.585045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.585475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.586157 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.586633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.587256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.600979 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c HTTP/1.1 Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:28:56.602652 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.604276 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '7e08ca80-55bf-497a-9724-e515aa65f78c'} Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:56.605325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. Aug 30 04:28:56.606878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:56.608284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 7e08ca80-55bf-497a-9724-e515aa65f78c could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:56.608284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0fa62820-f676-4644-81a9-33c31871ac2a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c" status: 404 len: 111 microversion: 2.1 time: 0.031784 Aug 30 04:28:56.608284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 501/983] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/7e08ca80-55bf-497a-9724-e515aa65f78c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:57.750222 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.750769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.757104 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.757581 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.758016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.758732 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.759188 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.759606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.773519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 HTTP/1.1 Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:28:57.775087 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.776637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'b423b7ae-20e1-4048-bae4-bfc3dfc38816'} Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:57.777406 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.779450 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.781020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:57.781020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8277856a-9958-49c1-9198-e5a679b8a57c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 404 len: 111 microversion: 2.1 time: 0.030591 Aug 30 04:28:57.781020 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 483/984] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:57 2022] DELETE /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:57.785591 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.786205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: b423b7ae-20e1-4048-bae4-bfc3dfc38816] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.792633 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.793107 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.794200 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.794960 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.795418 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.795843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.809216 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 HTTP/1.1 Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:28:57.810860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.812682 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'b423b7ae-20e1-4048-bae4-bfc3dfc38816'} Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:57.813599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. Aug 30 04:28:57.815125 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.817081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance b423b7ae-20e1-4048-bae4-bfc3dfc38816 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:57.817081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-743c93b0-988a-4e95-a7bf-980e9f908b73 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816" status: 404 len: 111 microversion: 2.1 time: 0.030666 Aug 30 04:28:57.817081 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 502/985] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/b423b7ae-20e1-4048-bae4-bfc3dfc38816 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:57.821835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.822361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.828978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.829454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.829889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.830606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.831058 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.831478 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.849253 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c HTTP/1.1 Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:28:57.850831 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.853557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '779aee38-94e4-4f4f-a800-6894170e718c'} Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:57.854864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.857102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.859552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:57.859552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-88a18833-04dc-45d4-b0ee-b3ad7842ea5a tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 404 len: 111 microversion: 2.1 time: 0.034201 Aug 30 04:28:57.859552 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 484/986] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:57 2022] DELETE /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:57.860923 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.861543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 779aee38-94e4-4f4f-a800-6894170e718c] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.867512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.867983 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.868412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.869095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.869545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.869965 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.883530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c HTTP/1.1 Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:28:57.885042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.886987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '779aee38-94e4-4f4f-a800-6894170e718c'} Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:57.888584 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. Aug 30 04:28:57.890094 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:57.891740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 779aee38-94e4-4f4f-a800-6894170e718c could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:57.891740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-059c0bed-ac3c-4b61-96d0-bccb081a1258 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c" status: 404 len: 111 microversion: 2.1 time: 0.029533 Aug 30 04:28:57.891740 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 503/987] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/779aee38-94e4-4f4f-a800-6894170e718c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:59.026567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.027079 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.034011 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.034528 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.034960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.035643 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.036090 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.036509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.049775 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 HTTP/1.1 Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:28:59.051353 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.052949 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '711629d5-ba60-4bfd-a61e-7a06e25db924'} Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:59.054073 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.055590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.057314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:59.057314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-29d3ab2c-9be6-4b86-928d-d4e674e3be37 tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 404 len: 111 microversion: 2.1 time: 0.030053 Aug 30 04:28:59.057314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 485/988] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:59 2022] DELETE /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:59.061544 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.062153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] [instance: 711629d5-ba60-4bfd-a61e-7a06e25db924] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.068303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.068713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.069145 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.069830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.070299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.070725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.084865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] HTTP exception thrown: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Request method failure captured: Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 HTTP/1.1 Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDzedgaF3czAylet6eIl48X4RedY4Bp-HaeCuABuW8gbS_nIKyDiD98KObCPlcc_eRmx-nbx_ZDIY2WOwgmxqRvuRHYX5GczEFjajntdS-2TDLysrwInuCHjt-uCIxEwmllMKeko3vphEmfQY5-sYo83vRGoOIWqmj05YA5v9cEyZY Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:28:59.086414 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c9311c57fdd4250a16560bd8c2e0ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 9c9311c57fdd4250a16560bd8c2e0ffc Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-805086042 Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 545b18260abe47ceb440d0713439c13b Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-AttachVolumeNegativeTest-805086042-project Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.088062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '711629d5-ba60-4bfd-a61e-7a06e25db924'} Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:59.089133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. Aug 30 04:28:59.090867 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:28:59.092403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] Returning 404 to user: Instance 711629d5-ba60-4bfd-a61e-7a06e25db924 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:59.092403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8949e28-6389-4808-afc3-2dd1d996091c tempest-AttachVolumeNegativeTest-805086042 tempest-AttachVolumeNegativeTest-805086042-project] 10.222.0.46 "GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924" status: 404 len: 111 microversion: 2.1 time: 0.030602 Aug 30 04:28:59.092403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 504/989] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:59 2022] GET /compute/v2.1/servers/711629d5-ba60-4bfd-a61e-7a06e25db924 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:02.305755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.306334 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:02.306743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.316908 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.317275 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.317579 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.317755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.318186 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.318338 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.318923 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.319373 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.330279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.331545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] Creating event network-changed:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:29:02.337339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-8b0a202a-42f7-41cd-accf-ee0df7939e70 req-549f62de-a129-4c2b-a47d-1505409bbfac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034821 Aug 30 04:29:02.343355 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 505/990] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:02.391605 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:02.518666 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c78307ca-5d62-479b-8180-6b9ef3081340 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 204 len: 0 microversion: 2.1 time: 0.219266 Aug 30 04:29:02.519531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 486/991] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:02 2022] DELETE /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:02.536597 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.538012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.545688 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.546475 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.547007 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.547800 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.548470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.548985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.707085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:02.720025 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d148e0b9-c612-4fd0-9ac2-0d5b15749a6b tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.188529 Aug 30 04:29:02.721191 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 506/992] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:02 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:03.741870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:03.743546 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:03.751426 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.752408 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.752960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.753753 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.754386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.754911 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.445727 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:04.456816 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4922ca99-d83d-46f8-a3a7-649c45abba54 tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1570 microversion: 2.1 time: 0.718416 Aug 30 04:29:04.457708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 487/993] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:03 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1570 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:05.010205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3b92a2-23a8-405c-b393-820424eddd08", "name": "network-vif-deleted", "tag": "063e08d6-d65f-4bd5-9b7c-48ede36416eb"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:05.021930 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.022436 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.022866 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.034187 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] Creating event network-vif-deleted:063e08d6-d65f-4bd5-9b7c-48ede36416eb for instance 0c3b92a2-23a8-405c-b393-820424eddd08 on hv-cinder-85220 Aug 30 04:29:05.040401 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-8bdf9526-343e-4223-9b24-e2f6755731ec req-6b6629bc-714f-4a65-a6bc-254ac53cd475 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033917 Aug 30 04:29:05.040993 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 507/994] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:05.478364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:05.479029 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:05.486557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.487117 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.487739 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.488435 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.489028 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.489484 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.561433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ba21f12574c4b9281d090651174788a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f04feca7a349e5a656f166dae05354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:05.569282 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d1179a58-e86a-41a8-a4dc-754883521f7f tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 200 len: 1219 microversion: 2.1 time: 0.094775 Aug 30 04:29:05.569841 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 488/995] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:05 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:06.590707 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.591517 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] [instance: 0c3b92a2-23a8-405c-b393-820424eddd08] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.597842 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.598357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.598827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.599527 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.599981 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.600403 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.613836 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] HTTP exception thrown: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Request method failure captured: Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 HTTP/1.1 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZDvV6ShxBMLAoRKdTy2BV_8U3lTRE4LpmrWmWttD0YOm80vIVmDGxO4G27hUQB7yC3hGBnTrp40o4Sgx6lhgfaXTQHnSmTnqaDVlDhyk2Tb6h8F-L8JaR9-WBAR6o-Mi8a_BmhN0hHv6-1jS7P_uPOVycfz0QHwzBKbdAbZxR4rsKE Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: b0f04feca7a349e5a656f166dae05354 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-TestShelveInstance-869953725 Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:29:06.615492 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b0f04feca7a349e5a656f166dae05354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b0f04feca7a349e5a656f166dae05354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b0f04feca7a349e5a656f166dae05354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b0f04feca7a349e5a656f166dae05354"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-TestShelveInstance-869953725 Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: b0f04feca7a349e5a656f166dae05354 Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestShelveInstance-869953725 Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-TestShelveInstance-869953725-project Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: 7ba21f12574c4b9281d090651174788a Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-TestShelveInstance-869953725-project Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. Aug 30 04:29:06.617201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '0c3b92a2-23a8-405c-b393-820424eddd08'} Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:06.618116 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. Aug 30 04:29:06.619657 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:06.621034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Returning 404 to user: Instance 0c3b92a2-23a8-405c-b393-820424eddd08 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:06.621034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bf15cc7a-3fc2-477f-ba18-1711146b9aaa tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08" status: 404 len: 111 microversion: 2.1 time: 0.031052 Aug 30 04:29:06.621034 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 508/996] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:06 2022] GET /compute/v2.1/servers/0c3b92a2-23a8-405c-b393-820424eddd08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:06.794393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-21acbf4f-72da-4ef1-aae4-c78d8f7446ee tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] Calling method '.version_select at 0x7faa0d5ee160>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.835220 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-21acbf4f-72da-4ef1-aae4-c78d8f7446ee tempest-TestShelveInstance-869953725 tempest-TestShelveInstance-869953725-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1393245950" status: 202 len: 0 microversion: 2.1 time: 0.045377 Aug 30 04:29:06.835916 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 489/997] 10.222.0.46 () {58 vars in 1254 bytes} [Tue Aug 30 04:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1393245950 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:32.931369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1759896497", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:32.939036 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:32.939677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:32.988940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] validate_networks() for None {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:33.476949 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:33.477367 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:33.477872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:33.478298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:33.478711 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:33.488358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.488833 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.489262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.489985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.490477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.490895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.507151 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Getting quotas for project 8652672950004ca0bd9912537a583b72. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:33.511222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Getting quotas for user bd0f822076f54525a4486d3a2ea1c727 and project 8652672950004ca0bd9912537a583b72. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:33.522432 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:33.524696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:33.570215 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a3471c07-57b0-40b5-a592-622900d2882e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642711 Aug 30 04:29:33.570909 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 509/998] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:29:33.580043 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:33.580865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:33.586063 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-591e8027-fcba-40c3-96ef-b5ef2f43f515 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.586743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-591e8027-fcba-40c3-96ef-b5ef2f43f515 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.654567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-591e8027-fcba-40c3-96ef-b5ef2f43f515 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:33.661641 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-591e8027-fcba-40c3-96ef-b5ef2f43f515 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1215 microversion: 2.1 time: 0.083174 Aug 30 04:29:33.662217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 490/999] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:34.684490 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:34.685955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:34.694687 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.695262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.695766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.696684 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.697142 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.697572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.768202 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.784662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-17d113c8-e935-408d-a2a8-deb32d8f879e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1275 microversion: 2.1 time: 0.105185 Aug 30 04:29:34.785351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 510/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:34 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:35.807410 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.818906 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.827434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.828297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.828810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.829613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.830144 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.830668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.354881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.363665 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-175cacf3-53f3-4203-9d7e-8f765d30c5a1 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.560824 Aug 30 04:29:36.364250 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 491/1001] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:36.676759 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1df951-90a0-43d9-8a98-291a6675c7d6", "tag": "6640764d-fa94-4220-8a54-db54fcf1033f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:36.687272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.687843 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.688378 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.700012 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] Creating event network-changed:6640764d-fa94-4220-8a54-db54fcf1033f for instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 on hv-cinder-85220 Aug 30 04:29:36.705087 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-66d732dc-798b-4813-8deb-67f450e12acc req-3e80b80b-c66d-476b-8499-5ed1d86bdd22 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033955 Aug 30 04:29:36.705691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 511/1002] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:37.386217 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:37.386855 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:37.394262 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.394754 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.395437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.396120 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.396560 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.396993 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.531544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.539102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-f30a0b5c-a1db-433d-b51f-69ce8cdee8e6 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.156811 Aug 30 04:29:37.539671 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 492/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:37 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:38.561880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.562526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:38.569588 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.570077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.570543 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.571232 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.571681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.572353 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.704941 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.712455 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c1c52fc0-c7c6-483f-9677-1e899c1caaae tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.155560 Aug 30 04:29:38.713017 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 512/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:39.733306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:39.733917 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:39.740509 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.740989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.741421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.742113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:39.742590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:39.743010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:39.875767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:39.883452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5e85039d-ca47-4524-9e14-c65cc14923b0 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.154385 Aug 30 04:29:39.884017 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 493/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:39 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.904917 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.905518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:40.912171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.912686 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.913120 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.913816 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.914285 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.914713 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.042674 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:41.050463 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9b8676b9-5e2b-4238-a7d5-1f971bb3fdec tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.150011 Aug 30 04:29:41.051053 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 513/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:42.072359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.072940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.080410 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.080804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.081259 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.081996 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.082472 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.082896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.090967 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1df951-90a0-43d9-8a98-291a6675c7d6", "name": "network-vif-plugged", "status": "completed", "tag": "6640764d-fa94-4220-8a54-db54fcf1033f"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:42.104185 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.107629 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.108062 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.120113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] Creating event network-vif-plugged:6640764d-fa94-4220-8a54-db54fcf1033f for instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 on hv-cinder-85220 Aug 30 04:29:42.125794 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-97927435-c811-4e03-b31b-a00aaf1d4e0a req-08c9315f-f81d-450d-899c-3e7803cde3cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039760 Aug 30 04:29:42.127053 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 514/1007] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:42.238387 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.247771 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-230aee47-b5e3-4ce9-bf76-357aca43946e tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.179338 Aug 30 04:29:42.248388 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 494/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:43.270976 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.271673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:43.277825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.278339 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.279509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.280205 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.280658 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.281079 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.439152 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.446911 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-78753e41-6959-4619-836d-b12108056a7d tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1315 microversion: 2.1 time: 0.181338 Aug 30 04:29:43.447485 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 515/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.468365 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.468977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.471374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.476687 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.477164 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.477596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.478315 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.478769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.479190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.615243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.623596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-73babedc-3929-49a4-b9f0-2013b37c72a5 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1465 microversion: 2.1 time: 0.159627 Aug 30 04:29:44.624093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 495/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.668477 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.669019 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.671775 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.672600 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.678751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.679279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.679733 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.680461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.680931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.681404 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.708257 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:44.787587 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b1b769e9-2fff-4c3a-9104-8c3bf9bd3885 tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 204 len: 0 microversion: 2.1 time: 0.122620 Aug 30 04:29:44.788226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 516/1011] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:44 2022] DELETE /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:44.797198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.797833 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.804092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.804576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.805010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.805695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.806150 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.806609 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.945433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.953492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-2c3c330e-0da3-4ae5-99b5-07db07d0e89b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1471 microversion: 2.1 time: 0.160918 Aug 30 04:29:44.954092 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 496/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:45.975931 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.976618 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.983508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.983974 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.984454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.985075 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.985518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.985929 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.120526 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0f822076f54525a4486d3a2ea1c727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8652672950004ca0bd9912537a583b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.129558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-ea0160fd-b0ca-476b-8d06-94fb8232067f tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 200 len: 1471 microversion: 2.1 time: 0.157777 Aug 30 04:29:46.130136 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 517/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:46.740126 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1df951-90a0-43d9-8a98-291a6675c7d6", "name": "network-vif-deleted", "tag": "6640764d-fa94-4220-8a54-db54fcf1033f"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:46.749749 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.750297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.750785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.762399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] Creating event network-vif-deleted:6640764d-fa94-4220-8a54-db54fcf1033f for instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 on hv-cinder-85220 Aug 30 04:29:46.767767 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-95c1a437-fc39-4fd5-bd3d-25de8343684b req-de1c33b7-bce3-41e9-aacf-b391114346b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189518 Aug 30 04:29:46.768352 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 497/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:47.150737 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.151398 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] [instance: 2e1df951-90a0-43d9-8a98-291a6675c7d6] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.159011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.159532 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.159984 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.160693 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.161162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.161605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.176082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] HTTP exception thrown: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Request method failure captured: Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 HTTP/1.1 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZIrh6uIYJcV2C1ueVM2sEky-jddX684uJin06adiZgYdXOfV5FhK_K6D0JxMajiWhNBR4vGO7HYikHhLssWOOo2KIbTXIdd8MsIOeMEctt5_QEks-i4VpOYQhCs3AHka_pdJRX1wCW5XIB5Qx1BFkY-oF4_JF8orSKq77p2ojG_wDE Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 8652672950004ca0bd9912537a583b72 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesNegativeTest-574614759 Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:29:47.177790 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8652672950004ca0bd9912537a583b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8652672950004ca0bd9912537a583b72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8652672950004ca0bd9912537a583b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8652672950004ca0bd9912537a583b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesNegativeTest-574614759 Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 8652672950004ca0bd9912537a583b72 Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesNegativeTest-574614759 Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesNegativeTest-574614759-project Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: bd0f822076f54525a4486d3a2ea1c727 Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesNegativeTest-574614759-project Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. Aug 30 04:29:47.179651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': '2e1df951-90a0-43d9-8a98-291a6675c7d6'} Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:47.180716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. Aug 30 04:29:47.182406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:47.183749 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] Returning 404 to user: Instance 2e1df951-90a0-43d9-8a98-291a6675c7d6 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:47.183749 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aedbc56e-2bea-41f1-a12d-5603cf7c404b tempest-VolumesNegativeTest-574614759 tempest-VolumesNegativeTest-574614759-project] 10.222.0.46 "GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6" status: 404 len: 111 microversion: 2.1 time: 0.032435 Aug 30 04:29:47.183749 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 518/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/2e1df951-90a0-43d9-8a98-291a6675c7d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:51.478725 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.479337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.486116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.486635 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.487198 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.487908 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.488364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.488773 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.516576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:51.605548 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa546387-605f-4ed2-969c-f83ce9dc5168 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 204 len: 0 microversion: 2.1 time: 0.131457 Aug 30 04:29:51.607506 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 498/1016] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:51 2022] DELETE /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:51.616000 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.617348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.625001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.625586 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.626105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.626895 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.627420 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.627853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.784983 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:51.793301 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-05ca599d-a510-4610-b66f-0535a95d5358 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1578 microversion: 2.1 time: 0.181548 Aug 30 04:29:51.793943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 519/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:51 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:52.821494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:52.822421 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:52.829881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.830399 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.831517 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.832226 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:52.832669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:52.833086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:52.990588 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.002545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c39ece0e-9dd9-4b03-bf19-d50fdbb95a7c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1578 microversion: 2.1 time: 0.186805 Aug 30 04:29:53.003712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 499/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:52 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:54.025284 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:54.026113 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:54.034096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.034703 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.036681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.036681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.036681 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.037061 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.071785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38295c3-20df-4922-b871-2b98a7c5791f", "name": "network-vif-deleted", "tag": "2f13d5a1-172c-4836-9776-4995855ff63b"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:54.084306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.085111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.085735 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.099477 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] Creating event network-vif-deleted:2f13d5a1-172c-4836-9776-4995855ff63b for instance a38295c3-20df-4922-b871-2b98a7c5791f on hv-cinder-85220 Aug 30 04:29:54.105970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:54.109774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-7ebabd72-a39f-4810-8b41-dafb3096ebdf req-d1df3cab-c618-47ac-86d7-b9d32fa94b21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041628 Aug 30 04:29:54.110459 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 500/1019] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:54.116133 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d33fcac2-8321-4d29-84c1-a2829cd83d02 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 200 len: 1511 microversion: 2.1 time: 0.094641 Aug 30 04:29:54.120224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 520/1020] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:54 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:54.615196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-303078720", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "networks": [{"uuid": "a3aa638b-3502-4aa0-b58d-c9b52149abcd"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:54.676320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] validate_networks() for [('a3aa638b-3502-4aa0-b58d-c9b52149abcd', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:55.136142 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:55.137248 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:55.137365 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:55.138371 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:55.138534 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.138954 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:55.139376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:55.145576 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.146060 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.146523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.147219 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.147672 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.148090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.148660 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.149159 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.149571 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.150453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.150845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.151213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.164010 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] HTTP exception thrown: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Request method failure captured: Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f HTTP/1.1 Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZGeFRHakOyB1qv1EQIyORNrV_6xOn_wS77AsItxyOelMB6F-i8iIUIaS36p-j55v8Kcp4bA9P-eO5wng56QfAULHwNGjdygEawy7nr0biF8GoNvWHvXqxHBwOUR0IiaIKpJL-lsDY2eVgjKYMrvkbmTuMGB-mSpJMZtUa6TXgi-8Og Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:29:55.165873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_59c345f38d6548cd820affce5406d62c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/59c345f38d6548cd820affce5406d62c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b301d6b1d85b4371abde52727d9b387e Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:29:55.167412 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a38295c3-20df-4922-b871-2b98a7c5791f'} Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:55.168256 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:29:55.170122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:29:55.172095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Getting quotas for project 3b90a52b66304d6a8396c2989bcc612b. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:55.173935 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Getting quotas for user e76baa3c1f8d48aca5c5109327e28640 and project 3b90a52b66304d6a8396c2989bcc612b. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:55.176275 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Returning 404 to user: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:55.177452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-818a97d0-2a84-497b-8dfc-6f833211e05a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 404 len: 111 microversion: 2.1 time: 0.043826 Aug 30 04:29:55.178431 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 521/1021] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:29:55.186715 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:55.189814 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:55.242951 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1649d989-18e5-4852-a6f9-3dd8cdffbb64 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632270 Aug 30 04:29:55.243607 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 501/1022] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:29:55.255146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-17b49cf9-9fac-4849-a231-cfa00a5bfb54 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:55.255757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-17b49cf9-9fac-4849-a231-cfa00a5bfb54 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.291838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-869503642", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449843651", "security_groups": [{"name": "tempest-secgroup-smoke-759749048"}], "block_device_mapping_v2": [{"uuid": "61359161-e977-4be2-b3e5-817edba1be80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8adf9578-c481-4463-b5d1-5bddee25fe02"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:55.317400 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-17b49cf9-9fac-4849-a231-cfa00a5bfb54 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.325995 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-17b49cf9-9fac-4849-a231-cfa00a5bfb54 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1218 microversion: 2.1 time: 0.074515 Aug 30 04:29:55.330306 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 522/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:55.417438 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] validate_networks() for [('8adf9578-c481-4463-b5d1-5bddee25fe02', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:29:55.837359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:55.837792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:55.838276 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:55.838693 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:55.839095 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:55.848381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.848852 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.849277 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.850016 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.850568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.850983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.867819 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:55.871669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for user b301d6b1d85b4371abde52727d9b387e and project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:55.931973 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:55.934273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61359161-e977-4be2-b3e5-817edba1be80',volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:56.078350 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-00aaa2b1-3b26-48dc-a6b3-5beab8469748 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.790322 Aug 30 04:29:56.079215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 502/1024] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:56.090077 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-c40e84a1-c384-4e79-ad06-49cf60cba282 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.090742 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-c40e84a1-c384-4e79-ad06-49cf60cba282 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.152571 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-c40e84a1-c384-4e79-ad06-49cf60cba282 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:56.159970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-c40e84a1-c384-4e79-ad06-49cf60cba282 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1094 microversion: 2.1 time: 0.073786 Aug 30 04:29:56.160653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 523/1025] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:56.349103 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.349724 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.359431 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.360027 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.360524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.361963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.362712 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.363294 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.502228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:56.511273 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ce52d962-c8bc-438c-979a-d6e80619a6b0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1278 microversion: 2.1 time: 0.167583 Aug 30 04:29:56.511854 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 503/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:57.188939 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.191313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.199937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.201818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.202890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.204461 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.205545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.206615 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.293648 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.302290 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e3224547-f3dc-43d9-979e-91fec444465c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1200 microversion: 2.1 time: 0.123774 Aug 30 04:29:57.302857 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 524/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1200 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:57.533347 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.533961 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.540294 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.540774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.541205 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.541896 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.543094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.543094 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.119159 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.127280 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-3b79bce5-8be8-4b24-bd9f-f61d2a4dd9b6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.597889 Aug 30 04:29:58.128096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 504/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.324263 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.324872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.331828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.332325 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.332735 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.333421 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.333865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.335286 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.397716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.406419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-57df0971-a9a7-4ac9-b7a9-fc876bdf47c2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1198 microversion: 2.1 time: 0.085795 Aug 30 04:29:58.407101 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 525/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.531393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18", "tag": "028501cf-5e88-4501-a75c-d3a583611d1a"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:58.542965 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.543629 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.544685 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.555733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] Creating event network-changed:028501cf-5e88-4501-a75c-d3a583611d1a for instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 on hv-cinder-85220 Aug 30 04:29:58.561326 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-87139784-8763-437a-88d8-fc7f0700184d req-3e2310ea-b0c2-4bdd-9cb9-d327f617010d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034476 Aug 30 04:29:58.562018 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 505/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:59.149479 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.150245 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.157955 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.158567 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.161043 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.162053 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.162645 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.163169 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.296861 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.304540 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-575890ed-4a5a-4a01-90eb-70593dc92e0d tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.159516 Aug 30 04:29:59.305138 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 526/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:59.428174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.429119 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.436590 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.437299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.437726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.438445 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.438892 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.439316 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.657888 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.665510 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-bed70ed7-97b5-4045-b1dc-530174a9ce40 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.241738 Aug 30 04:29:59.666102 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 506/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:00.326943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.327491 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.333766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.334237 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.334698 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.335383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.335827 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.336603 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.471757 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.479558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d2849ef3-a064-4859-80f3-0d51a84a221c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.157125 Aug 30 04:30:00.480234 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 527/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:00.592065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0012cc-390a-49c1-9a99-f304bd689b83", "tag": "97a3f3f8-bce0-468c-86b5-94677bb38667"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:00.601736 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.602204 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.602646 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.613810 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] Creating event network-changed:97a3f3f8-bce0-468c-86b5-94677bb38667 for instance 0f0012cc-390a-49c1-9a99-f304bd689b83 on hv-cinder-85220 Aug 30 04:30:00.618551 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-436157be-a547-4edf-94ec-80e37f1a0d46 req-6841ec00-7717-4313-814e-9be7323411b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030266 Aug 30 04:30:00.619129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 507/1034] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:00.688508 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.689122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.695547 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.696037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.696505 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.697267 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.697267 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.697267 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.849044 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.857685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-30bbf4bd-ad8e-456e-8b3e-31474bf69fe0 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.174603 Aug 30 04:30:00.858277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 528/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:01.501369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.502003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.508134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.508631 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.509045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.509726 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.510174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.510654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.643105 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.650909 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ba44fec8-8ab9-4207-9e67-378ea812f118 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.154010 Aug 30 04:30:01.651467 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 508/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:01.878299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.878962 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.885410 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.885887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.886351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.887070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.887523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.888598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.892860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:02.023865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.031989 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-bbddb124-c06f-4e82-856d-4b81e6f3e8e1 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.157641 Aug 30 04:30:02.032554 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 529/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:02.672701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.673320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.680323 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.680492 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.680883 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.681583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.682036 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.682489 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.816340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.819924 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:02.824796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-dafb4e17-054f-4301-a6b3-90319bf68ed7 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.156649 Aug 30 04:30:02.825442 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 509/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.052965 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.053486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.055767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:03.061868 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.062383 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.062825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.063512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.063962 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.064379 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.199970 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.208249 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7facdb65-eba0-4c12-8696-6f4f661c2891 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.159284 Aug 30 04:30:03.208820 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 530/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.846125 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.846772 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.848979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:03.855116 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.855601 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.856034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.857451 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.858033 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.858491 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.992449 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.000633 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d9fe57d2-3bed-4852-a99e-862ef7c7fc99 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.159554 Aug 30 04:30:04.001206 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 510/1040] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:04.228952 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.229504 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.237343 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.237832 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.238279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.239004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.239456 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.239882 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.384090 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.395883 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-48b02326-8d18-4681-8d42-7395bb06c4de tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.170462 Aug 30 04:30:04.396465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 531/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:04.396796 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18", "name": "network-vif-plugged", "status": "completed", "tag": "028501cf-5e88-4501-a75c-d3a583611d1a"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:04.406722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.407197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.407630 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.419398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] Creating event network-vif-plugged:028501cf-5e88-4501-a75c-d3a583611d1a for instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 on hv-cinder-85220 Aug 30 04:30:04.425731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-5f6c54cb-e6e1-4d2b-a63f-a95ef83bb20d req-d1749549-8329-49ea-b853-78caeeebaec0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187984 Aug 30 04:30:04.426376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 511/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:05.021818 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.022397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.028277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.028766 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.029291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.029975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.030458 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.030879 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.159088 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.166608 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8e8d3af5-cea1-47ce-910a-3a8c5483159a tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1318 microversion: 2.1 time: 0.148957 Aug 30 04:30:05.167167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 532/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:05.417645 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.418416 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.425737 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.426216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.426842 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.427522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.427976 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.428398 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.571311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.579676 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c8c54712-9e8e-4e99-8f5c-07ced23f6e49 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.166716 Aug 30 04:30:05.580297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 512/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:06.187632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.188246 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.190589 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=4 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.196262 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.196741 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.197173 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.197864 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.198841 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.198943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.333373 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.342086 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f1471593-ef8e-463f-8a39-1fa0310708d3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1506 microversion: 2.1 time: 0.158654 Aug 30 04:30:06.342715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 533/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:06.597952 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=4 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.600043 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=12 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:06.605813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.606538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.616599 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.617086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.617702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.618637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.619267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.619693 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.825944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.835389 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-1fd87590-c1bc-4ef8-b6df-cd5dd29b658a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.238208 Aug 30 04:30:06.835975 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 513/1046] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:07.856673 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.857272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.863937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.864337 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.864774 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.865468 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.865916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.866369 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.009146 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.017435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9d00b9fe-00ec-44a3-b71f-2e80e79ab4ab tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.164818 Aug 30 04:30:08.018002 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 534/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:09.038707 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.039320 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.047183 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.047668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.048139 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.048864 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.049318 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.049769 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.182971 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:09.191313 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-4f8ab126-6c9a-4e01-a7e1-c4ad534e4973 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.156416 Aug 30 04:30:09.191895 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 514/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:10.213416 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:10.214084 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:10.222366 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.222860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.223291 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.224073 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.224523 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.224942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.297875 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0012cc-390a-49c1-9a99-f304bd689b83", "name": "network-vif-plugged", "status": "completed", "tag": "97a3f3f8-bce0-468c-86b5-94677bb38667"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:10.308039 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.308708 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.309311 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.324755 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] Creating event network-vif-plugged:97a3f3f8-bce0-468c-86b5-94677bb38667 for instance 0f0012cc-390a-49c1-9a99-f304bd689b83 on hv-cinder-85220 Aug 30 04:30:10.331464 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-bb7234a0-a0ad-4239-85d1-5202a5d9befe req-bbb44968-d42f-4f49-9d7b-2a81099caf27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037607 Aug 30 04:30:10.332261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 515/1049] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:10.397199 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.405022 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e6b0d15-5bbc-44b4-b01c-2bb4f4d60d72 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.195809 Aug 30 04:30:10.405765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 535/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:10 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:11.428706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.429404 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.438776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.439288 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.439733 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.440466 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.440919 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.441335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.589010 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:11.597710 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6b5b0d3e-2d07-4e60-973a-c88a8bef8010 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1265 microversion: 2.1 time: 0.173695 Aug 30 04:30:11.598305 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 516/1051] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:12.619696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.620310 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.627462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.627876 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.628307 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.629001 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.629450 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.629871 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.772189 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.780411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-b891b47d-a67f-454f-a921-f1493ca6fa31 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1452 microversion: 2.1 time: 0.164375 Aug 30 04:30:12.781089 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 536/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:12.801776 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.802437 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.809152 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.809644 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.810078 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.813197 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.813674 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.814109 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.966998 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.975504 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-5991103d-7cf3-44a5-ae5a-2facaee08617 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1452 microversion: 2.1 time: 0.177802 Aug 30 04:30:12.976076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 517/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:14.705377 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0012cc-390a-49c1-9a99-f304bd689b83", "tag": "97a3f3f8-bce0-468c-86b5-94677bb38667"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:14.714819 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.715293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.715718 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.727191 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] Creating event network-changed:97a3f3f8-bce0-468c-86b5-94677bb38667 for instance 0f0012cc-390a-49c1-9a99-f304bd689b83 on hv-cinder-85220 Aug 30 04:30:14.732601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-fbbf534a-39a4-4e62-981f-4a5057016d4d req-bf598366-65ef-4446-9373-084cd147f7e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095854 Aug 30 04:30:14.736513 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 537/1054] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:22.708019 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c77b06b-e433-431d-93e1-7542647f0d32", "device": "/dev/sdb"}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:22.710839 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:22.717596 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.718069 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.718523 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.719494 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.719830 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.720668 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.964252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-689f3e96-7134-4200-891b-7b410b2c2137 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "POST /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260539 Aug 30 04:30:22.968372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 518/1055] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:30:22 2022] POST /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:45.705446 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=15 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:45.706725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=48 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:45.714082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:45.715082 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:45.723027 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.723510 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.723950 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.724649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.725104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.725530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.833211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lazy-loading 'services' on Instance uuid fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:45.914643 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1fb00547-22ed-4dd5-b253-059b74b73972 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18/os-volume_attachments/6c77b06b-e433-431d-93e1-7542647f0d32" status: 202 len: 0 microversion: 2.1 time: 0.211298 Aug 30 04:30:45.915294 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 538/1056] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:30:45 2022] DELETE /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18/os-volume_attachments/6c77b06b-e433-431d-93e1-7542647f0d32 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:30:47.046522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:47.047099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:47.049555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=17 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:47.051148 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:47.058613 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.059325 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.059963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.061065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.061778 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.062418 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.091977 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Going to try to terminate instance {{(pid=120495) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:47.176299 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-b7643dc8-8056-4b1e-941c-c7d7aa6aa810 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 204 len: 0 microversion: 2.1 time: 0.133545 Aug 30 04:30:47.177441 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 519/1057] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:47 2022] DELETE /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:47.186771 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:47.187471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:47.194066 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.194609 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.195045 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.195738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.196192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.196617 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.331659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.339478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f2ef0a9b-5f20-4957-8678-a9cd0efb4faf tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1512 microversion: 2.1 time: 0.157562 Aug 30 04:30:47.340083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 539/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:47 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:48.361583 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:48.362865 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:48.369308 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.369785 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.370216 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.370926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.371375 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.371794 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.501337 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.509524 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-64602136-72bf-4002-8619-cba5d5452bd3 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1512 microversion: 2.1 time: 0.152237 Aug 30 04:30:48.510084 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 520/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:48 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:49.301476 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18", "name": "network-vif-deleted", "tag": "028501cf-5e88-4501-a75c-d3a583611d1a"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:49.311830 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.312572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.313180 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.325029 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] Creating event network-vif-deleted:028501cf-5e88-4501-a75c-d3a583611d1a for instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 on hv-cinder-85220 Aug 30 04:30:49.329558 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-e4551691-0cc0-4f86-8346-3417e05ac229 req-0f3a5d58-409d-4a2e-8f4b-596148d8648b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Aug 30 04:30:49.330144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 540/1060] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:49.531265 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:49.532112 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.539324 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.539808 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.540243 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.540939 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.541392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.541813 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.573395 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.573874 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.574344 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.574791 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lazy-loading 'fault' on Instance uuid fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:30:49.615983 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.623566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-06511b25-ac42-45e1-b907-a7cabcb681e8 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 200 len: 1308 microversion: 2.1 time: 0.096165 Aug 30 04:30:49.624167 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 521/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:49 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:50.645731 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.646462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.652621 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.653163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.653592 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.654296 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.654753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.655175 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.669489 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] HTTP exception thrown: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Request method failure captured: Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 HTTP/1.1 Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZJB9Z1dJmBoq6pdn0SjJaBy7UETXwTk9m1SMpchDL_qJZcMRe5wGMXFq5og7UnSllfhOLe7gMXZtw3Dd-gNYZq2w8l0ezDpZ-gNocxv2txKMQZRP1PnHcCn-fgenxNHYATRfn5xS03XFk2azpM3YTy8SpO_ztrR-MDRvIaFHK916PE Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 3b90a52b66304d6a8396c2989bcc612b Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:30:50.671282 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 3b90a52b66304d6a8396c2989bcc612b Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-VolumesSnapshotTestJSON-2100359224-project Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: e76baa3c1f8d48aca5c5109327e28640 Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-VolumesSnapshotTestJSON-2100359224-project Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. Aug 30 04:30:50.673070 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18'} Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:50.674095 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. Aug 30 04:30:50.676545 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:30:50.677987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Returning 404 to user: Instance fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:50.677987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-97dfcf0a-88d4-4216-b2d2-07b682f1f844 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18" status: 404 len: 111 microversion: 2.1 time: 0.032297 Aug 30 04:30:50.677987 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 541/1062] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/fc2756e2-16b6-4711-bfc0-e8e3f2d7fe18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:58.462361 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1607025312", "imageRef": "af0ceb4d-1796-4571-a32e-851fb2cba8df", "flavorRef": "452", "networks": [{"uuid": "a3aa638b-3502-4aa0-b58d-c9b52149abcd"}]}} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:58.524332 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.network.neutron [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] validate_networks() for [('a3aa638b-3502-4aa0-b58d-c9b52149abcd', None, None, None, None, None)] {{(pid=120495) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:30:59.140498 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Flavor limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:59.140918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Image limits 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:59.141393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Flavor pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:59.141801 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Image pref 0:0:0 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:59.142211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.virt.hardware [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:59.153195 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.153678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.154111 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.154886 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.155346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.155765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.173335 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Getting quotas for project 3b90a52b66304d6a8396c2989bcc612b. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:59.177761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.quota [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Getting quotas for user e76baa3c1f8d48aca5c5109327e28640 and project 3b90a52b66304d6a8396c2989bcc612b. Resources: {'ram', 'cores', 'instances'} {{(pid=120495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:59.188779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Going to run 1 instances... {{(pid=120495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:59.191447 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af0ceb4d-1796-4571-a32e-851fb2cba8df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:59.238463 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ced1a154-97bf-4805-a317-18f57102c081 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779885 Aug 30 04:30:59.239113 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 522/1063] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:59.249725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-9af1972b-fe81-46a0-b609-97d18b9e1d96 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.250459 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-9af1972b-fe81-46a0-b609-97d18b9e1d96 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.307110 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-9af1972b-fe81-46a0-b609-97d18b9e1d96 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.314014 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-9af1972b-fe81-46a0-b609-97d18b9e1d96 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1219 microversion: 2.1 time: 0.068134 Aug 30 04:30:59.314572 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 542/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:00.337938 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:00.338638 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:00.346746 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.347279 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.347940 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.349482 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.350065 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.350564 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.455000 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.463846 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ffadcbf7-4697-4b30-9b74-b5f2f9ad3e4e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1289 microversion: 2.1 time: 0.131792 Aug 30 04:31:00.464738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 523/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:00 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:01.484725 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.485358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.488651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:01.495298 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.495784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.496208 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.496898 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.497341 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.497754 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.552720 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3bb3a4c-e3cf-4727-afca-7189445375d1", "tag": "c13f7aed-e9d1-4001-a6f9-7cba41ebe783"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:01.566213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.566213 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.566606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.581655 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] Creating event network-changed:c13f7aed-e9d1-4001-a6f9-7cba41ebe783 for instance d3bb3a4c-e3cf-4727-afca-7189445375d1 on hv-cinder-85220 Aug 30 04:31:01.586914 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-6a01e846-37c1-4808-ab4f-659c26ef1011 req-2c4d8587-69a1-4300-9618-12f70e47eea9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039086 Aug 30 04:31:01.587873 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 524/1066] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:01.641880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.650417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aa023b1b-2102-4bbc-b6ab-084216edc09e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.169504 Aug 30 04:31:01.650997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 543/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:02.672056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.672756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.679942 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.680544 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.681024 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.681720 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.682170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.682621 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.813538 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.822323 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e0c96e5-40ef-4991-a0c9-f53441ab5ad6 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.154433 Aug 30 04:31:02.822907 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 525/1068] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:03.843654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.844264 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.851397 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.851872 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.852300 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.852982 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.853425 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.853837 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.985166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.992880 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-aa38cde3-943f-43f2-9112-9840b28860f9 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.153097 Aug 30 04:31:03.993452 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 544/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:05.012960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.013531 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.020910 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.021382 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.021811 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.022519 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.022964 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.023381 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.158918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.166522 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-27681427-73f4-4b38-8205-a5b2037a4b8e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.157509 Aug 30 04:31:05.167096 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 526/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.186890 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.187506 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.194197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.194702 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.195131 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.195824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.196272 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.196695 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.332805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.340675 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-38009698-06fe-408d-84c6-d795b7573890 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.157622 Aug 30 04:31:06.341507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 545/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.600006 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3bb3a4c-e3cf-4727-afca-7189445375d1", "name": "network-vif-plugged", "status": "completed", "tag": "c13f7aed-e9d1-4001-a6f9-7cba41ebe783"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:06.611682 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.612162 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.612764 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.624191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] Creating event network-vif-plugged:c13f7aed-e9d1-4001-a6f9-7cba41ebe783 for instance d3bb3a4c-e3cf-4727-afca-7189445375d1 on hv-cinder-85220 Aug 30 04:31:06.630215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-fd47d804-d6ac-4127-8b17-1d649a2ece24 req-f612ef06-7582-458c-8f46-205998eb04dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Aug 30 04:31:06.631393 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 527/1072] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:07.362659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.363269 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.369817 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.370311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.370743 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.371427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.371905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.372320 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.506144 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:07.513737 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-5e2f8805-4ffd-48a8-875c-cc2d9ddf47c0 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1319 microversion: 2.1 time: 0.156036 Aug 30 04:31:07.514435 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 546/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:08.537680 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:08.538411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:08.544537 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.545014 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.545444 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.546124 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.546606 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.547031 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.678097 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.685804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ecc53b54-9e25-4ddf-afa5-e7b784b9cc95 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1507 microversion: 2.1 time: 0.153358 Aug 30 04:31:08.686430 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 528/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:08 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:08.706804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c44f95ad-dc45-4ed0-81ad-77219c6df9e3", "device": "/dev/sdb"}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:08.709634 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:08.716191 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.716677 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.717112 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.717805 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.718313 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.718739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.968347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8333c543-379d-4729-98ad-3db3ef9ce866 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "POST /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265535 Aug 30 04:31:08.969122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 547/1075] 10.222.0.46 () {60 vars in 1323 bytes} [Tue Aug 30 04:31:08 2022] POST /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:27.284076 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.284608 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.286542 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:27.287196 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=6 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:27.288131 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:31:27.288376 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Tue Aug 30 04:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1/os-volume_attachments/c44f95ad-dc45-4ed0-81ad-77219c6df9e3 (ip 10.222.0.46) !!! Aug 30 04:31:27.290999 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:27.291637 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:27.306570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.307122 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.307669 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.308370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.308821 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.309570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.398025 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.objects.instance [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lazy-loading 'services' on Instance uuid d3bb3a4c-e3cf-4727-afca-7189445375d1 {{(pid=120495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:27.471155 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-9e1c3989-9fbd-4ccd-bdec-70823f6d2351 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1/os-volume_attachments/c44f95ad-dc45-4ed0-81ad-77219c6df9e3" status: 202 len: 0 microversion: 2.1 time: 0.190943 Aug 30 04:31:27.471790 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 529/1076] 10.222.0.46 () {58 vars in 1416 bytes} [Tue Aug 30 04:31:27 2022] DELETE /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1/os-volume_attachments/c44f95ad-dc45-4ed0-81ad-77219c6df9e3 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:28.589047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:28.590653 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:31:28.590828 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Tue Aug 30 04:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 (ip 10.222.0.46) !!! Aug 30 04:31:28.592004 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=22 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:28.592649 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:28.598478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.599064 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.614042 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.614551 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.614985 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.615685 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.616139 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.616557 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.654078 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:31:28.734008 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2b53309a-1ee6-46b3-83eb-36116a2c678e tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 204 len: 0 microversion: 2.1 time: 0.146112 Aug 30 04:31:28.734647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 548/1077] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:31:28 2022] DELETE /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:31:28.744946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.745696 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.753845 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.754367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.754806 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.755521 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.755978 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.756396 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.895841 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.903828 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-6bdfdf20-5165-42f7-8b09-90a8023ec10c tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1513 microversion: 2.1 time: 0.163664 Aug 30 04:31:28.904419 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 530/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:29.926902 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.927602 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.933954 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.934471 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.934907 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.935599 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.936048 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.936465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.069247 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:30.076780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-07dbeda0-66ef-4875-b2ab-ec4c1ae0c113 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1513 microversion: 2.1 time: 0.154860 Aug 30 04:31:30.077348 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 549/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:30.779944 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3bb3a4c-e3cf-4727-afca-7189445375d1", "name": "network-vif-deleted", "tag": "c13f7aed-e9d1-4001-a6f9-7cba41ebe783"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:30.791843 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.792321 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.792743 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.806066 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] Creating event network-vif-deleted:c13f7aed-e9d1-4001-a6f9-7cba41ebe783 for instance d3bb3a4c-e3cf-4727-afca-7189445375d1 on hv-cinder-85220 Aug 30 04:31:30.811193 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-052e540e-5ee4-464b-b769-4d94589f67a9 req-752b4694-198c-42c1-9410-1f4d7d3cb34a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035396 Aug 30 04:31:30.811990 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 531/1080] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:31.097311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:31.097918 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.104344 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.104823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.105261 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.105947 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.106430 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.106859 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.137661 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.138137 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.138598 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.139044 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lazy-loading 'fault' on Instance uuid d3bb3a4c-e3cf-4727-afca-7189445375d1 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:31:31.180784 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76baa3c1f8d48aca5c5109327e28640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b90a52b66304d6a8396c2989bcc612b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.189806 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-39e00828-a790-438c-99e7-c41b8bae4b24 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 200 len: 1309 microversion: 2.1 time: 0.095925 Aug 30 04:31:31.190524 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 550/1081] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:31 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.213987 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.214740 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] [instance: d3bb3a4c-e3cf-4727-afca-7189445375d1] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.221933 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.222440 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.222876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.223566 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.224015 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.224434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.238086 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] HTTP exception thrown: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Request method failure captured: Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 HTTP/1.1 Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZJB9Z1dJmBoq6pdn0SjJaBy7UETXwTk9m1SMpchDL_qJZcMRe5wGMXFq5og7UnSllfhOLe7gMXZtw3Dd-gNYZq2w8l0ezDpZ-gNocxv2txKMQZRP1PnHcCn-fgenxNHYATRfn5xS03XFk2azpM3YTy8SpO_ztrR-MDRvIaFHK916PE Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 3b90a52b66304d6a8396c2989bcc612b Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:31:32.239722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3b90a52b66304d6a8396c2989bcc612b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 3b90a52b66304d6a8396c2989bcc612b Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2100359224 Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-VolumesSnapshotTestJSON-2100359224-project Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: e76baa3c1f8d48aca5c5109327e28640 Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-VolumesSnapshotTestJSON-2100359224-project Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. Aug 30 04:31:32.241555 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'd3bb3a4c-e3cf-4727-afca-7189445375d1'} Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:32.242488 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. Aug 30 04:31:32.243898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:31:32.245228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] Returning 404 to user: Instance d3bb3a4c-e3cf-4727-afca-7189445375d1 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:32.245228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-ca4e9704-e929-40c0-9488-499fdeb9c193 tempest-VolumesSnapshotTestJSON-2100359224 tempest-VolumesSnapshotTestJSON-2100359224-project] 10.222.0.46 "GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1" status: 404 len: 111 microversion: 2.1 time: 0.031825 Aug 30 04:31:32.245228 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 532/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/d3bb3a4c-e3cf-4727-afca-7189445375d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:00.530865 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569437882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1449843651", "security_groups": [{"name": "tempest-secgroup-smoke-759749048"}], "block_device_mapping_v2": [{"uuid": "df8d8ee6-5b77-4728-8d82-86af7f4442a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8adf9578-c481-4463-b5d1-5bddee25fe02"}]}} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:00.541835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:00.542518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:00.859242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.network.neutron [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] validate_networks() for [('8adf9578-c481-4463-b5d1-5bddee25fe02', None, None, None, None, None)] {{(pid=120496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 04:32:01.332516 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:01.332975 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image limits 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:01.333451 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Flavor pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:01.333889 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Image pref 0:0:0 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:01.334336 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.virt.hardware [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:01.343417 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.343897 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.344329 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.345047 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.345498 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.345922 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.364715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:01.368622 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.quota [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Getting quotas for user b301d6b1d85b4371abde52727d9b387e and project 59c345f38d6548cd820affce5406d62c. Resources: {'ram', 'cores', 'instances'} {{(pid=120496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:01.426321 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Going to run 1 instances... {{(pid=120496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:01.428447 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df8d8ee6-5b77-4728-8d82-86af7f4442a6',volume_size=None,volume_type=None)] {{(pid=120496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:01.567114 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-a572f854-2d24-453b-8dff-94806c4966be tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040222 Aug 30 04:32:01.568072 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 551/1083] 10.222.0.46 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:32:01.578782 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-49b8d4e4-9350-471f-8909-6a83928a9873 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.579386 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-49b8d4e4-9350-471f-8909-6a83928a9873 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.582055 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=8 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:01.583861 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:01.644571 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-49b8d4e4-9350-471f-8909-6a83928a9873 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.651452 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-49b8d4e4-9350-471f-8909-6a83928a9873 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1094 microversion: 2.1 time: 0.076701 Aug 30 04:32:01.652212 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 533/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:01 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.676201 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.676946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.686590 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.687228 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.687662 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.688356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.688804 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.689253 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.759997 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.768080 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-778307b0-138e-4fa5-93db-c7ec83384371 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1210 microversion: 2.1 time: 0.097696 Aug 30 04:32:02.768696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 552/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:03.788989 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.789593 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.797093 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.797570 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.798003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.798722 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.799170 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.800099 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.008918 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:04.017881 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-c145404e-e58d-412c-9554-6c452ecb6d7b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.232554 Aug 30 04:32:04.018545 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 534/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:03 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:04.051162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850a567e-8335-4eb6-bb7b-668825278af3", "tag": "e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22"}]} {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:04.062782 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.063277 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.063694 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.075206 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.compute.server_external_events [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] Creating event network-changed:e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22 for instance 850a567e-8335-4eb6-bb7b-668825278af3 on hv-cinder-85220 Aug 30 04:32:04.081188 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [req-2b4625b6-80f7-4be7-90ef-1a0e1ec42d76 req-f93a54f3-164f-45a2-909c-695839c82c90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 Aug 30 04:32:04.081406 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 553/1087] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:05.038701 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:05.039241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:05.046182 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.046695 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.047134 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.047837 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.048289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.048711 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.249034 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.256774 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aacd41c3-9474-452b-b1e5-020aeed86436 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.222606 Aug 30 04:32:05.257340 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 535/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:05 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.278470 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.279163 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.285266 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.285738 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.286166 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.286904 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.287347 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.287761 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.428507 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.436143 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-2a1b7fc7-a46f-495f-8304-79eaa980957a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.162338 Aug 30 04:32:06.436709 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 554/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:07.459252 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.459869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.466731 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.467221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.467654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.468364 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.468969 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.469306 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.607798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:07.616056 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-0bbdabda-f4da-49c7-ab92-c67726bda334 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.161327 Aug 30 04:32:07.616926 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 536/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:08.636772 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:08.637370 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:08.644751 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.645226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.645651 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.646372 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.646824 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.647235 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.776796 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.784858 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-326e89d7-d536-4493-ab85-77b70b3fc6bf tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.151983 Aug 30 04:32:08.785427 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 555/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:08 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:09.805293 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.805960 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.812802 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.813281 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.813709 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.814424 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.814869 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.815405 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.962115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:09.969702 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-8399fd37-fe84-4ced-8984-de1be5922d0d tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.168268 Aug 30 04:32:09.970271 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 537/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:10.989499 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.990098 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.996647 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.997122 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.997548 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.998226 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.998691 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.999105 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.132887 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.140835 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-944ca1c0-e5df-4b9b-a9a2-fbc7f8d8b971 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.155270 Aug 30 04:32:11.141411 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 556/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:12.162654 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:12.163261 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:12.165618 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell0:SELECT=2 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:12.171390 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.171870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.172294 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.172979 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.173419 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.173835 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.313779 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.322211 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-65b4a5d1-0c3d-4a63-b5e3-5c2e96088931 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.163668 Aug 30 04:32:12.322904 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 538/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:12 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.343624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:13.344231 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:13.346222 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=2 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:13.346905 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell0:SELECT=6 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:13.353423 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.353903 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.354358 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.355052 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.355525 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.355946 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.488216 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.495873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f8802748-43a4-402b-936a-15a5a82a7288 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.156169 Aug 30 04:32:13.496878 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 557/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:13 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.896706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850a567e-8335-4eb6-bb7b-668825278af3", "name": "network-vif-plugged", "status": "completed", "tag": "e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:13.907840 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.908367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.909514 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.921958 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] Creating event network-vif-plugged:e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22 for instance 850a567e-8335-4eb6-bb7b-668825278af3 on hv-cinder-85220 Aug 30 04:32:13.928485 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-8e4fef13-b5db-4776-9fcb-7be68c29ad24 req-e1e3c2b5-272d-4661-82bb-f2524c13daa3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Aug 30 04:32:13.929258 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 539/1096] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:14.517943 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.518601 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.524509 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.524988 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.525419 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.526104 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.527083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.527083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.658197 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.666606 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-8c8cef35-46ad-4ca8-9661-43bf1a73dab5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1265 microversion: 2.1 time: 0.152972 Aug 30 04:32:14.667167 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 558/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.688798 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.689739 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.696372 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.696838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.697267 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.697941 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.698411 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.698827 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.828533 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:15.836749 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-74b22ac9-2ced-4ccf-b958-4ffefdcd4a4b tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1453 microversion: 2.1 time: 0.152655 Aug 30 04:32:15.837314 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 540/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.856746 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.857351 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.864562 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.865037 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.865465 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.866156 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.866632 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.867050 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.008478 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.016288 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-0d4a64aa-0455-4f42-9206-cdd4f9e103ee tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1453 microversion: 2.1 time: 0.163303 Aug 30 04:32:16.016853 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 559/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.622013 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850a567e-8335-4eb6-bb7b-668825278af3", "tag": "e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:17.632191 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.632667 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.633118 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.645858 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] Creating event network-changed:e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22 for instance 850a567e-8335-4eb6-bb7b-668825278af3 on hv-cinder-85220 Aug 30 04:32:17.651468 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-18c3bd0d-4fad-46d0-b12b-8ad23404fb81 req-a7b7e049-14c5-42e4-a429-ccf5f9d4613a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Aug 30 04:32:17.652106 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 541/1100] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:45.861607 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:45.862171 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:45.864530 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.865238 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG dbcounter [-] [120496] Writing DB stats nova_cell1:SELECT=46 {{(pid=120496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.865553 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_api:SELECT=20 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.866420 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG dbcounter [-] [120495] Writing DB stats nova_cell1:SELECT=40 {{(pid=120495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.867799 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:33:45.868022 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Tue Aug 30 04:33:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Aug 30 04:33:45.875873 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.876469 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.876937 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.877839 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.878486 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.879083 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.881889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850a567e-8335-4eb6-bb7b-668825278af3", "tag": "e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:45.892898 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.893374 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.893804 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.905719 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] Creating event network-changed:e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22 for instance 850a567e-8335-4eb6-bb7b-668825278af3 on hv-cinder-85220 Aug 30 04:33:45.907096 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:45.910934 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-407be0bd-d64c-4c44-96b9-24ade4a96234 req-51449093-0e86-41dd-ab74-6c3bbe48f27f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047380 Aug 30 04:33:45.911849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 542/1101] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:45.998916 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-7da667a7-1a73-4fce-b8cc-462512190828 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 204 len: 0 microversion: 2.1 time: 0.141493 Aug 30 04:33:45.999810 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 560/1102] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:45 2022] DELETE /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:46.010003 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:46.010893 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:46.017950 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.018475 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.018932 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.019616 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.020359 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.020963 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.179756 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:46.187706 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-cc2ddc50-4c36-4995-9134-d845b704989e tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1577 microversion: 2.1 time: 0.183246 Aug 30 04:33:46.188289 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 543/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:46 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:47.210299 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:47.211303 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:47.217716 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.218211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.218663 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.219395 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.219848 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.220270 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.362753 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:47.370812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d820ab8e-5d98-470c-8882-c9dfef38dd8c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1577 microversion: 2.1 time: 0.165521 Aug 30 04:33:47.371415 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 561/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:47 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:48.045297 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850a567e-8335-4eb6-bb7b-668825278af3", "name": "network-vif-deleted", "tag": "e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:48.061661 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.062567 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.063255 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.076368 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] Creating event network-vif-deleted:e9ebc32b-5d7e-4f2f-ab82-c4afd768ac22 for instance 850a567e-8335-4eb6-bb7b-668825278af3 on hv-cinder-85220 Aug 30 04:33:48.081081 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-91deb7b8-140f-4283-aeb5-6f4d436420e6 req-1f0371eb-d7b7-48d0-b909-ecb0fc3c6de6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040699 Aug 30 04:33:48.081678 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 544/1105] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:48.398825 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:48.399454 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:48.407515 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.408770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.408770 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.409439 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.409892 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.410356 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.448242 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.448739 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.449174 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.449624 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lazy-loading 'fault' on Instance uuid 850a567e-8335-4eb6-bb7b-668825278af3 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:48.496596 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:48.508799 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-1ded6280-fee0-47a6-982b-8beec9f3fce5 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 200 len: 1230 microversion: 2.1 time: 0.115099 Aug 30 04:33:48.509362 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 562/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:48 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:49.530454 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:49.531349 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 850a567e-8335-4eb6-bb7b-668825278af3] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:49.539174 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.540655 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.541091 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.541787 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.542346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.542766 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.561457 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] HTTP exception thrown: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Request method failure captured: Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 HTTP/1.1 Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZGeFRHakOyB1qv1EQIyORNrV_6xOn_wS77AsItxyOelMB6F-i8iIUIaS36p-j55v8Kcp4bA9P-eO5wng56QfAULHwNGjdygEawy7nr0biF8GoNvWHvXqxHBwOUR0IiaIKpJL-lsDY2eVgjKYMrvkbmTuMGB-mSpJMZtUa6TXgi-8Og Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:33:49.563154 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_59c345f38d6548cd820affce5406d62c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/59c345f38d6548cd820affce5406d62c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b301d6b1d85b4371abde52727d9b387e Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. Aug 30 04:33:49.565568 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '850a567e-8335-4eb6-bb7b-668825278af3'} Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:49.566738 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. Aug 30 04:33:49.569370 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:49.571312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Returning 404 to user: Instance 850a567e-8335-4eb6-bb7b-668825278af3 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:49.571312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-aa96046b-1aa8-4b55-9c6c-a0fb238ef71a tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3" status: 404 len: 111 microversion: 2.1 time: 0.039089 Aug 30 04:33:49.571312 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 545/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:49 2022] GET /compute/v2.1/servers/850a567e-8335-4eb6-bb7b-668825278af3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:52.651891 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:52.652462 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:52.653762 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0012cc-390a-49c1-9a99-f304bd689b83", "tag": "97a3f3f8-bce0-468c-86b5-94677bb38667"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:52.658942 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.659701 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.660210 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.660983 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.661512 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.662020 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.664894 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.665369 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.665792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.677225 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] Creating event network-changed:97a3f3f8-bce0-468c-86b5-94677bb38667 for instance 0f0012cc-390a-49c1-9a99-f304bd689b83 on hv-cinder-85220 Aug 30 04:33:52.683305 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-923884c2-8cdd-4511-b6bc-ec6deaa91f04 req-b1af419b-e45a-42d2-8c2f-a4874f4fd6cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Aug 30 04:33:52.684215 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 546/1108] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:52.692823 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Going to try to terminate instance {{(pid=120496) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:52.781040 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-42c8c0a4-0930-401d-b454-f2a4e351f1b4 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 204 len: 0 microversion: 2.1 time: 0.132995 Aug 30 04:33:52.781654 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 563/1109] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:52 2022] DELETE /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:52.794040 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:52.794859 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:52.802367 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.803929 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.804598 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.805720 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.806244 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.810603 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.954946 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.policy [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120495) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:52.963282 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-d36538f5-b484-40bd-bdbe-b1916feec176 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1577 microversion: 2.1 time: 0.175183 Aug 30 04:33:52.963857 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 547/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:52 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:53.985583 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.986308 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.994659 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.995158 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.995605 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.996314 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.996765 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.997187 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.244162 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:54.251948 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-e1c237f5-f398-47f4-b577-3f70233a1a90 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1577 microversion: 2.1 time: 0.270784 Aug 30 04:33:54.252518 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 564/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:53 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:55.003889 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0012cc-390a-49c1-9a99-f304bd689b83", "name": "network-vif-deleted", "tag": "97a3f3f8-bce0-468c-86b5-94677bb38667"}]} {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:55.014876 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.015346 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.015792 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.027576 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.compute.server_external_events [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] Creating event network-vif-deleted:97a3f3f8-bce0-468c-86b5-94677bb38667 for instance 0f0012cc-390a-49c1-9a99-f304bd689b83 on hv-cinder-85220 Aug 30 04:33:55.033129 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [req-537d2962-78b0-4426-9864-341e6aa6425f req-0ab55b9c-ea08-40ac-aa7f-d4c1b5d9f296 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032857 Aug 30 04:33:55.033718 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 548/1112] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:55.276233 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:55.276881 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:55.284224 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.284715 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.285155 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.285860 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.286357 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.286780 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.329153 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.329679 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.330311 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.330575 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.objects.instance [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lazy-loading 'fault' on Instance uuid 0f0012cc-390a-49c1-9a99-f304bd689b83 {{(pid=120496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 04:33:55.378767 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.policy [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b301d6b1d85b4371abde52727d9b387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c345f38d6548cd820affce5406d62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120496) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:55.387287 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-d9bb9ba3-6cad-4064-af8a-eb8d8c5e07bb tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 200 len: 1230 microversion: 2.1 time: 0.116207 Aug 30 04:33:55.387893 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 565/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:55 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:56.410490 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:56.411115 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: 0f0012cc-390a-49c1-9a99-f304bd689b83] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:56.417902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.418453 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.418870 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:56.419557 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:56.420009 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:56.420434 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:56.434433 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] HTTP exception thrown: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Request method failure captured: Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 HTTP/1.1 Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZGeFRHakOyB1qv1EQIyORNrV_6xOn_wS77AsItxyOelMB6F-i8iIUIaS36p-j55v8Kcp4bA9P-eO5wng56QfAULHwNGjdygEawy7nr0biF8GoNvWHvXqxHBwOUR0IiaIKpJL-lsDY2eVgjKYMrvkbmTuMGB-mSpJMZtUa6TXgi-8Og Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:33:56.436045 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_59c345f38d6548cd820affce5406d62c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/59c345f38d6548cd820affce5406d62c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b301d6b1d85b4371abde52727d9b387e Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. Aug 30 04:33:56.437838 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': '0f0012cc-390a-49c1-9a99-f304bd689b83'} Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:56.439072 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. Aug 30 04:33:56.440765 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:56.442558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Returning 404 to user: Instance 0f0012cc-390a-49c1-9a99-f304bd689b83 could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:56.442558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-174b8545-0448-4bd5-8e8f-64e032f0e720 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83" status: 404 len: 111 microversion: 2.1 time: 0.031971 Aug 30 04:33:56.442558 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 549/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:56 2022] GET /compute/v2.1/servers/0f0012cc-390a-49c1-9a99-f304bd689b83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:57.099803 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:57.100293 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.compute.api [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120496) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:57.107085 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.107566 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.107994 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.108696 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.109127 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.109549 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG oslo_concurrency.lockutils [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.122940 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.wsgi [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] HTTP exception thrown: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Request method failure captured: Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: request: DELETE /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f HTTP/1.1 Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept: application/json Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Accept-Encoding: identity Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Connection: close Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Length: 0 Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Content-Type: application/json Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Host: 10.222.0.46 Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: Openstack-System-Scope: None Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Auth-Token: gAAAAABjDZGeFRHakOyB1qv1EQIyORNrV_6xOn_wS77AsItxyOelMB6F-i8iIUIaS36p-j55v8Kcp4bA9P-eO5wng56QfAULHwNGjdygEawy7nr0biF8GoNvWHvXqxHBwOUR0IiaIKpJL-lsDY2eVgjKYMrvkbmTuMGB-mSpJMZtUa6TXgi-8Og Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Id: None Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Domain-Name: None Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Identity-Status: Confirmed Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Is-Admin-Project: True Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Id: default Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Domain-Name: Default Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Project-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Role: reader,member Aug 30 04:33:57.124582 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Roles: reader,member Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_59c345f38d6548cd820affce5406d62c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/59c345f38d6548cd820affce5406d62c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-Tenant-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Id: default Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Domain-Name: Default Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Id: b301d6b1d85b4371abde52727d9b387e Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: X-User-Name: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: method: > Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: exception: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.126279 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: action_args: {'id': 'a38295c3-20df-4922-b871-2b98a7c5791f'} Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:57.127192 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.129011 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.130708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Returning 404 to user: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. {{(pid=120496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:57.130708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-18b2cff2-2115-42ef-bb6e-0aecf0d30f6c tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 404 len: 111 microversion: 2.1 time: 0.030078 Aug 30 04:33:57.130708 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 566/1115] 10.222.0.46 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:57 2022] DELETE /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:57.135241 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '>' {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:57.135849 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.compute.api [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] [instance: a38295c3-20df-4922-b871-2b98a7c5791f] Fetching instance by UUID {{(pid=120495) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:57.142221 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.142761 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.143190 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.143878 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Acquiring lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.144329 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.144749 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG oslo_concurrency.lockutils [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Lock "09c659a1-71e8-4f8a-9c9a-b85f07b69ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120495) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.158922 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.wsgi [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] HTTP exception thrown: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Request method failure captured: Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: request: GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f HTTP/1.1 Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept: application/json Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Accept-Encoding: identity Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Connection: close Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Length: 0 Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Content-Type: application/json Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Host: 10.222.0.46 Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: Openstack-System-Scope: None Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Auth-Token: gAAAAABjDZGeFRHakOyB1qv1EQIyORNrV_6xOn_wS77AsItxyOelMB6F-i8iIUIaS36p-j55v8Kcp4bA9P-eO5wng56QfAULHwNGjdygEawy7nr0biF8GoNvWHvXqxHBwOUR0IiaIKpJL-lsDY2eVgjKYMrvkbmTuMGB-mSpJMZtUa6TXgi-8Og Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Id: None Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Domain-Name: None Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Identity-Status: Confirmed Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Is-Admin-Project: True Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Id: default Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Domain-Name: Default Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Project-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Role: reader,member Aug 30 04:33:57.160432 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Roles: reader,member Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_59c345f38d6548cd820affce5406d62c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/59c345f38d6548cd820affce5406d62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/59c345f38d6548cd820affce5406d62c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Id: 59c345f38d6548cd820affce5406d62c Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-Tenant-Name: tempest-TestVolumeBootPattern-1982646457 Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Id: default Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Domain-Name: Default Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Id: b301d6b1d85b4371abde52727d9b387e Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: X-User-Name: tempest-TestVolumeBootPattern-1982646457-project Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: method: > Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: exception: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.162290 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: action_args: {'id': 'a38295c3-20df-4922-b871-2b98a7c5791f'} Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: {{(pid=120495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:57.163508 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. Aug 30 04:33:57.165392 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: ERROR nova.api.openstack.wsgi Aug 30 04:33:57.166902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: DEBUG nova.api.openstack.wsgi [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Returning 404 to user: Instance a38295c3-20df-4922-b871-2b98a7c5791f could not be found. {{(pid=120495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:57.166902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: INFO nova.api.openstack.requestlog [None req-04353340-ea8f-444c-a4fb-eb3a6450de41 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f" status: 404 len: 111 microversion: 2.1 time: 0.031047 Aug 30 04:33:57.166902 dv-cinder-852208-11-iscsi devstack@n-api.service[120495]: [pid: 120495|app: 0|req: 550/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:57 2022] GET /compute/v2.1/servers/a38295c3-20df-4922-b871-2b98a7c5791f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:58.463595 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: DEBUG nova.api.openstack.wsgi [None req-f43ace84-e2fd-441a-8415-3d82aff1fce2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] Calling method '.version_select at 0x7faa0d6e8310>' {{(pid=120496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:58.495211 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: INFO nova.api.openstack.requestlog [None req-f43ace84-e2fd-441a-8415-3d82aff1fce2 tempest-TestVolumeBootPattern-1982646457 tempest-TestVolumeBootPattern-1982646457-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1449843651" status: 202 len: 0 microversion: 2.1 time: 0.036227 Aug 30 04:33:58.495812 dv-cinder-852208-11-iscsi devstack@n-api.service[120496]: [pid: 120496|app: 0|req: 567/1117] 10.222.0.46 () {58 vars in 1263 bytes} [Tue Aug 30 04:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1449843651 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)